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THEREOF 



BACKGROUND OF THE INVENTION 

FIELD OF INVENTION 

The following disclosure relates generally to correlating statistical records and more 
particularly to correlating compensation records to unique Individual profiles. 

BACKGROUND OF THE INVENTION 

Today, many reports are available that allow a user to find, read, purchase, or 
otherwise acquire reports on worker compensation. Most often these reports indicate 
average pay rates by industry, job type, locale, and sometimes they report more 
specific information about a particular industry or job. such as bonuses, stock options, 
average workweek, or immigration status, among other things. To create such 
compensation reports two approaches are typically used. One such approach is for a 
human analyst to research and find a statistically valid number of individuals with like 
characteristics, and devise a suite of compensation reports. This process is tedious, 
labor intensive and often expensive. For a truly detailed report the analyst must be 
relied on to do substantial investigation and synthesize and apply this information to 
the case at hand. Compensation consultants with years of experience and resources 
can generally accurately profile an individual's worth in the market place. However, 
such an analysis is extremely specialized and out of the reach of the typical consumer. 
Simpler and less costly reports are available but they are generally broadly classed 
and offer little utility. 

Simpler and less costly reports are available but they are generally broadly classed 
and offer less utility. The majority of software-based analysis provides a less 
expensive alternative but yields correspondingly limited information. Compensation 
services using current computer analysis programs generally gather data using some 
form of questionnaire and then feed the appropriate data into a computer database or 
spreadsheet. Or more typically, generalized data, such as from the US Bureau of 
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Labor and Statistics, are used as a base and then extrapolated based on region and 
date, and often combined with third party surveys. Typically, a computer then is 
instructed to run an analysis of the data to provide statistical information such as 
averages, medians, and standard deviations on pre-determined groups of people. 

5 However, the information provided is not unique to an individual, but instead is a 
conglomeration of data that the program feels best represents the individual. Because 
the categorization of the individual is based solely on a limited, predetermined set of 
responses to the questionnaire, it offers little to no opportunity for evaluating unique 
characteristics. For example, an automated compensation service may categorize and 

10 calculate data showing that the average yearly salary of a "Computer Programmer 
Level 3" in Washington state is $64,250. This may or may not be applicable to a 
"Senior Application Software Engineer" with ten years of experience and special 
training in the skill C++, but because the closest answer describing the Senior 
Application Software Engineer's position in the initial survey was a "Computer 

15 Programmer Level 3," the Senior Application Software Engineer has thus been 
categorized ineffectively, which removes any unique abilities he may possess. 

The Senior Application Software Engineer reading the aforementioned report cannot 
be sure how closely the published report figures apply to himself individually. There 

20 are a multitude of factors that affect any one individual's job compensation. The cunrent 
generalized reporting methods for compensation reports cannot and do not incorporate 
Actors that provide for an accurate job comparison and compensation analysis for 
individual users. Today's methods require the user to gauge or self-approximate 
themselves to a group of people being reported. Typically, such approximations are 

25 grouped by a specific job title that a human compensation analyst predetermines when 
creating a report or when designing a computer service that eventually generates the 
report. This grouping is generally not an exact match with the user's actual job title and 
responsibilities and often has little applicability to the users individual qualities. For 
example, the compensation analyst might have created a report for an isolated group 

30 called Computer Programriner Level 3. For individuals who possess the same 
characteristics as the data files used to create this group, the reports generated from 
such a compensation analysis are reasonably accurate. However, for individuals 
possessing unique capabilities, experiences, skills, or talents, the reports are 
essentially useless. The data are by definition misapplied because any differences in 
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the compared data are arbitrarily reflected in the compensation report. This introduces 
doubt on the user's part as to how closely he can trust the report's applicability. 

Current compensation analysis techniques do not provide users with affordable, 
accurate, and personalized compensation reports. Job specific variables, critical to the 
accurate assessment of an individual's worth, are not correctly identified or uniformly 
applied. Furthermore, individuals within a particular field are unaware of the value of 
certain, often easily obtainable, qualifications. There is a need, therefore, for a system 
and method to provide online compensation reports using a more flexible survey 
system that produces dynanriic profiles based on unique individual attributes and 
automated comparisons, and reports that account for these attributes. 

SUMMARY OF THE INVENTION 

The invention overcomes the limitations of the prior art and provides additional 
benefits. Under one aspect of the invention, profiles are used to produce individualized 
compensation reports. A survey engine is used to produce profiles of individuals that 
identify the individuals' unique characteristics. The survey engine incorporates a 
collaborative filtering engine that determines appropriate questions to ask the user 
during the survey, and also provides suggested possible answers. Additionally, the 
system allows for the use of open-text questions. Open-text questions allow for new 
answers to be input by the user, without the prior need for an administrator to pre- 
define the possible values for the system, as is typical in prior art. The system 
incorporates affinity groups around profile attributes (question answers), providing a 
basis for gauging similarity of profiles for various comparison and aggregation 
purposes described herein. A collaborative filtering engine is incorporated, which is 
both periodically modified by an administrator, and also tuned by users themselves 
based on their actions and responses. New affinity groups (associations of profiles) 
are incorporated by the survey engine to suggest new questions and possible answers 
in a survey. Additionally, some affinity groups are generated automatically by the 
system, and finally by users themselves to create new interesting relationships among 
profiles. 

The collaborative filtering engine enables the capture of profile attributes that are 
targeted compensation variables concerning a profile. The system automatically 
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incorporates new profiles into existing affinity groups, which allows more targeted 
survey questions and possible answers to be detemnined without requiring constant 
human training or intervention. 

Without a collaborative filtering system, the system is unable to administer surveys 
accurately for users who do not fit into pre-defined categories, it is impossible to 
categorize every occupational variation because the system allows for open-text 
answers to questions, and because the system provides for different questions to be 
determined automatically and asked for differing types of user job profile, the 
collaborative filtering system, along with affinity groups and other requirements 
described herein, is employed. Because the collaborative filtering system allows for the 
system to make educated guesses within defined constraints, the system can handle 
new categorizations more effectively than a system wholly defined by a human 
administrator. Additionally, in this system, the administrator defines constraints that 
prohibit the survey from asking obviously wrong or out of place questions. An example 
of a constraint is requiring that if the user does not answer any of the suggested 
questions, a default question is always asked. 

A new and surprising efliect of using a collaborative filtering system to define a survey 
is that the system is accommodates a much larger population of data using a more 
targeted survey. Previous implementations of compensation surveys relied on a 
smaller sample size, a broad survey with generalized questions, or a larger base of 
analysts to design and conduct surveys and categorize the data. Thus, the survey was 
constrained purely by the human resources needed to conduct it. The invention 
described herein is not constrained as such and requires far fewer human resources to 
conduct such a detailed survey across many different job categories. 

Another key aspect of the invention includes the ability to search through the data that 
have been collected by the survey engine, using detailed search criteria defined by a 
search definition document. The document applies a scoring and filtering mechanism 
that returns the most appropriate set of profiles based on the user's goal for the 
analysis. The search document is useful because it allows an administrator to define 
natural relationships between profile atb^ibutes, such as those that apply routinely to 
the realm of compensation analysis of various classes of profiles. The document is 
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then interpreted by a software algorithm, and used during the retrieval of relevant 
profiles, which can then be used for tallying and reporting. Multiple search definition 
documents can be created quickly, each one for a different goal. For example, one 
search goal may weight skills and certifications very highly. The results are useful for 
5 analyzing how to compare people with similar technical skills. Another search definition 
document weights experience and education higher, which is useful in seeing how a 
user compares to those profiles who have similar experience and education levels, A 
third example holds location constant, and compares a user to all other profiles with 
matching attributes in the same location. 

10 

Another aspect of the invention includes the automated ability to summarize and 
present the results of a profile search in a format that is useful to a human for 
compensation comparisons. A chart is defined as a series of values, such as skills, 
paired with a series of measures, such as average salary, median salary, standard 

15 deviation, etc. A sample chart is called "Average Salary By Skill" and it lists each Skill 
along with an associated average salary. A report is defined as a series of charts 
combined to provide an overall picture and analysis for a user. For instance, consider 
a report that aims to discover how a user compares with regard to skills and 
experience in similar jobs. This report incorporates many charts, as defined previously. 

20 which are combined into a format that gives a user a good analysis and understanding 
of the results of the user's search goal. 

Prior art approaches are unable to automate the selection of charts within a 
compensation report, such as detennining if "Average Salary by Practice Area" is 

25 applicable to a report presented for a particular user profile (it may only be applicable 
to a Lawyer, for instance). The prior art requires that the administrator know In 
advance, every chart that is relevant for a particular user. This shortcoming restricted 
previous inventions in one of two ways: limited the number of charts available, such 
that all charts were available to all compensation reports, regardless of their relevance, 

30 or they predefined different compensation reports by industry or job category, which 
would require a large amount of labor. 

The invention described herein determines if a chart is relevant to a user based on the 
user's own profile, and displays it, and also only shows it if enough data exists for it to 
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be valid statistically. There may be thousands of different charts of many different 
types and based on many different attributes and measures, and only a subset of them 
may apply to a particular users' compensation analysis. For instance, a lawyer may 
wish to see a report conceming "Average Bonus by Number of Hours Billed per Year." 
but this report is not applicable to teachers or CEOs. In the prior art. each of these 
compensation reports Is compiled by a human analyst, created at expense, or details 
are ignored, leaving only the most common charts in the compensation report, such as 
"Average Salary by Occupation and Location," which are often the least useful to an 
individual trying to compare his compensation against his peers. The invention herein 
allows for a more targeted and relevant compensation report by focusing in an 
automated, scalable fashion, on attributes that are unique to a user, in addition to the 
attributes that are most common to all users. 

One skilled in the art would also recognize that such a system could be used to match 
individual profiles to resumes because the profiles described herein are typically a 
subset of data gathered for a resume. For example, a user entering a profile into the 
system described herein could be easily matched to resumes using the same 
mechanisms employed to match against other profiles. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is an overview of a website implementation of the system according to the 
invention; 

Figure 2 is a general user flow through tiie system according to the invention; 

Figure 3 is a specific user flow for the first time a user accesses the system according 

to the invention; 

Figure 4 is a flow for the system to suggest a FieldGroup to a user according to the 
invention; 

Figure 5 is a flow for saving a user's answer to a database according to the invention; 
Figure 6 is an exemplary profile according to the invention; 
Figure 7 is an example of the systeni suggesting a FieldGroup in the survey 
Figure 8 is a continuation of Figure 7 

Figure 9 is an example of the system suggesting popular answers for a FieldGroup. in 
the survey according to the invention; 

Figure 10 is a continuation of Figure 9 according to the invention; 
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Figure 1 1 is a flow for calculating and summarizing data according to the invention; 

Figure 12 is a flow for storing tokenized data in a database according to the invention; 

Figure 13 is a flow for populating an affinity group according to the invention; 

Figure 14 is a flow for generating a custom report for a user according to the invention; 

Figure 15 is an overview of the different aspects of a profile search according to the 

invention; 

Figure 16 is a flow for a profile search according to the invention; 

Figure 17 is an example of an affinity group, according to the invention; 

Figure 18 is a flow for the rules engine according to the invention; 

Figure 19 is a series of rules used in the rules engine according to the invention; 

Figure 20 is an exemplary apparatus in accordance with the disclosed invention being 

further connected to a network according to the invention; 

Figure 21 is an exemplary flowchart for the purpose of creating a user specific affinity 
group according to the invention; 

Figure 22 is an exemplary flowchart showing the profile search process according to 
the invention; 

Figure 23 is an exemplary XML code for profile matching according to the invention; 
Figure 24 is an exemplary flowchart the matching of a user profile to an affinity group 
according to the invention; and 

Figure 25 is an exemplary flowchart for reporting of resulte of a matching process. 

DETAILED DESCRIPT OF THE INVENTION 

A method and system for providing targeted online compensation reports that 
accounts for unique individual job characteristics by using dynamic profiles is 
described in detail herein. In the following description, numerous specific details are 
provided for survey flow, affinities, levels, suggest FieldGroup, suggest popular 
answers, save answers, profile search, scoring system, report aggregation, and rules 
engine. One skilled in the relevant art, however, will recognize that the invention can 
be practiced without one or more of the specific details, or with other symbols, 
methods, etc. In other instances, well-known methods or techniques are not shown; or 
are not described in detail, to avoid obscuring aspects of the invention. 
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Definitions 

Field - A single piece of information, corresponding to a particular question asked by 
the system. Examples. "City." "State." "Bonus Amount." "Skill." and "Job Title." 

FieldGroup - A set of related Fields that form a logical grouping of information into a 
single record. Also often referred to as a Question. Examples: "Salary" is a FieldGroup 
consisting of "Salary Amount." "Currency." and "Average Workweek." "Job Location" is 
a FieldGroup consisting of "City." "State." and "Country." 

Survey - A set of FieldGroups asked in a particular order. An administrator may fix the 
order, or the system may determine the order using the "Suggest FieldGroup" 
algorithm defined below. 

AnswerValue (also Value, Answer or Attribute) - A value (piece of information) 
corresponding to a Field, used as a response. Example: For field "City." 
AnswerValues could be "Seattle." "San Francisco." "Miami," or "Paris." 

Profile - A set of FieldGroups, Fields and AnswerValues that form a logical 
representation of an individual person or group of people. Example: 
"lndustry=Finance. Job=Accountant. Employer-Name=Ernst & Young, 
Certification=CPA, Certification=CMA, Specialty=Taxation. Specialty=Cost Accounting. 
Years-ln-Field=12. Salary-Amount=60,000, Salary-Currency=US Dollars. Salary- 
WorkweekMO Hours, Location-City=Baltimore. Location-State=Maryland. Location- 
Country=USA, School-Name=Princton, School-Degree=Masters. School- 
DegreeYear=1995, Age=43, etc." 

Affinity Group (or Affinity) - A grouping of profiles that share common profile attributes, 
and further as shown in Fig. 17. Example: "All People who work in Law or Legal 
Professions." 

Affinity Definition - A Boolean representation of the common attributes shared by an 
affinity group. Example: For "All People who work in Law or Legal Professions", the 
affinity definition might be: "Job=Lawyer OR Job=Attorney OR Job=District Court 
Judge or lndustry=Legal OR Specialty=Trial Law OR etc." 
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Profile Search - A detailed set of criteria used for matching profiles to other profiles 
and creating a scoring system that ranks the validity of the match. 

5 Profile Search Document - A document that encompasses the criteria defined for the 
profile search. 

Chart - An aggregation of data limited to an affinity group, in a format understandable 
to an end user. Example: Bar Chart for "Average Salary By Specialty." 

10 

Report - A set of charts combined in a specific layout to provide a detailed analysis of 
a profile search and comparison goal. 

Overview 

15 Every individual possesses unique distinguishing characteristics in their employment 
profile. These unique characteristics, even when seemingly minor, can correspond to 
differences in employment compensation. Being able to have a custom report that 
compares relevant characteristics for each individual, and having an understanding of 
what the market is willing to pay for the individual's abilities based on such 

20 comparison, is an important step in finding and effectively negotiating employment 
opportunifies, as well as making informed career decisions. The method and 
apparatus presented herein provide comparative compensation reports based on 
characteristics determined through a survey and a scored-attribute-matching search 
and reporting process. 

25 

Reference is now made to Fig. 2 where a general user flow through the system is 
shown. A user begins the investigation of their worth by accessing an Internet Website 
through a user interface, such as a personal computer, personal data assistant, or 
similar device. Once access has been established, the user conveys to the system his 
30 desired compensation comparison objectiVes/goals, as shown in Pig. 1. Once the 
objectives have been identified a survey engine, also referred to as survey wizard, 
begins identifying the unique characteristics of the user that are most applicable to 
detennining a compensation level. The survey engine uses a combination of open and 
closed FieldGroups to create an individual profile. An open FieldGroup is defined as 
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having at least one Field for which the user may enter an answer in free text. A dosed 
FieldGroup is defined as having a Fields for which the user may only select from a list 
of predefined choices. After each FieldGroup is answered during the survey process, 
the individual profile is associated with one or more affinity groups. The affinity groups 
are discrete groupings of individual profiles based on Boolean criteria. The Boolean 
criteria, either simple or complex, are based on a combination of values from one or 
more attributes on a profile, such as job, skill, location, etc. A user's profile attributes 
are compared against each affinity definition, and if the profile attribute meets the 
affinity definition criteria, the user is considered to be a member of that affinity group. 
For example, a user may be considered part of the affinity group "People in 
Information Technology/Computer Networi<ing" if they have answered having certain 
skills, such as Skill=TCP/IP, SkilNCisco Routers, Skill= Windows NT Networicing, or 
Certification=Microsoft Certified Systems Engineer. 

The sun/ey engine, or system, discussed in more detail below, through iteration, asks 
FieldGroups of the user until the engine determines no more FieldGroups should be 
asked. Upon beginning the survey process, the user's objectives/goals are confirmed 
through an initial set of questions, as shown in Fig. 1. The goal establishes broad 
areas that should be investigated by the survey engine. The engine, using this goal, 
suggests the next FieldGroup (Question) to be posed to the user, from the set of ail 
available FieldGroups in the system shown in Fig. 4. The FieldGroup along, with 
possible popular answers obtained from previous questioning of different users, is 
presented to the user. The system examines the answer offered by the user and, If 
appropriate, saves it in a database, as shown in Fig. 5. This process continues until 
the engine determines that the desired goal has been ascertained and no more 
FieldGroups need to be asked. The engine queries if any more goals need to be 
examined returning the process to establishing a goal for Questioning. The process 
continues as described herein until profile data for all the applicable goals are created 
and the survey is complete. 

The system uses affinities or affinity groups to categorize and group users in many 
segments of the application. An affinity group is defined as a group of profiles defined 
by a set of profile criteria, called an affinity definition. Affinity definitions are a 
combination of values from fields defined in the system also shown in Fig. 6. For 
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example. Job=Human Resource Manager is an affinity definition for the affinity group 
consisting of all the profiles such that users answered Job=Human Resources 
Manager. Criteria can be logically defined to create more complex criteria, using 
standard Boolean operators such as AND and OR. For example, the affinity group 

5 called "San Francisco Java Programmers" might have the following affinity definition: 
"City=San Francisco AND (Job=Software Programmer or Job=Software Developer or 
Job=Web Developer) AND Skill=Java." The corresponding set of profiles that match 
this definition is the affinity group. The affinity definition is stored in a relational fonnat, 
which is easily and quickly retrievable, and searchable. One skilled in the art would 

10 recognize that such a definition could be stored in a wide variety of formats suitable to 
the task at hand, or modified for improved CPU performance. A program quickly 
compares the user's profile to all affinity definitions stored in the system, and 
detennines to which affinity groups a user belongs. One skilled in the art would be able 
to recognize that more complicated affinities are possible, using more complex 

15 Boolean logic such as NOT, XOR, etc. Additionally, affinities can be created which 
group numeric data by ranges. For instance, all people in a certain age range could be 
grouped together. Affinities are associations of data, defined by a human, an 
administrator, or users, which allow the system to create a more intelligent output for 
use by many of the sub-systems described herein. Additional detail is provided below 

20 in the form of flowcharts. 

The survey engine is required to ask FieldGroups that are relevant for a particular 
user. Many different Job profiles have different attributes that affect one's 
compensation. For example, a CEO may need an answer to the FieldGroup (question) 

25 Company Revenue in his profile, while a Lawyer might need Practice Area or Bar 
Association Memberships. The suggest FieldGroup algorithm is designed to ask 
pertinent questions of the user depending on the user's compensation analysis goal 
and the type of profile the user has, learned through iterative questioning. Open-text 
questions provide a unique challenge in automated systems because an administrator 

30 cannot anticipate them. For instance, the prior art allows for a selection of an industry 
from a drop-down list box containing a set of known values. Because all industries are 
known to the system, logic could be added to recommend a new question based upon 
the answer to the previous question. In such a system, a complex decision tree is 
created in advance, and the system is able to create a custom survey based upon the 
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answers given by the user. However, these systems are subject to the limitation of 
l<nowing all possible answers, and spending a significant amount of labor to program 
the decision tree to account for all possibilities. It also makes it very difficult to add 
new questions because the added responsibility of mapping each answer to the 
5 decision tree must be part of the process. The invention described herein is not subject 
to such limitations because it allows the entry by users of any answer. Typically, this 
open-ended question Is enabled by a text box with few restrictions on what can be 
entered, versus a drop down box, where a user must select one of the pre-defined 
answers. 

10 

Because the system allows open-ended text answers, a standard expert system is not 
possible because it Is impossible to create a decision tree for an infinite number of 
questions that would make up a survey. In such situations in other art, an artificial 
intelligence mechanism is usually employed to deal with the unknown variances in 

15 user input concerning which questions the users answer, as well as what those 
answers are. However, the invention requires that a high degree of recall is 
maintained, which means a new user coming and using the system with the same set 
of profile data as an existing user, should have the same set of FieldGroups 
recommended in the same order (deterministic). To accommodate these requirements. 

20 i.e. both recall and variability, the system employs a system that defines relationships 
between FieldGroups, a minimum set of required FieldGroups. and an order that the 
FieldGroups appear during the survey. These system rules are combined with a set of 
weights and a subsystem which allows a qualified guess as to which FieldGroups 
should be suggested next, without requiring a predefined survey for each unique type 

25 of job profile. 

To pick the next FieldGroup to be asked of the user, the survey engine selects the 
most popular FieldGroup that the user has not yet answered, but that is related to the 
FieldGroups already posed to the user, and which Is also contained in the profiles of 
30 the affinity groujaCs) to which the user currently belongs, subject to the level constraints 
and FieldGroup relafionships described herein. An administrator establishes the 
relationships and levels for FieldGroups, prior to a user completing the survey. As 
explained eariier, the system uses a collaborative filtering architecture for the survey 
engine to allow for a large number of FieldGroups and minimal administrative input. 
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Although a collaborative filtering architecture is used, an alternative architecture such 
as a neural network might also be employed. Administrative tasks related to 
Suggesting FieldGroups are limited to cleaning input data that is used to teach the 
system, defining FieldGroup Relations, defining FleldGroup Levels, and defining 
5 affinity groups. 

The inputs to the survey engine are a user's previous answers, affinity groups, 
relationships between FieldGroups (FieldGroup relations document). FieldGroup levels 
(or FieldGroup priority), and a triplet called "Popular FieldGroups," that consists of an 

10 affinity group, a FieldGroup, and a weighted value. The output for the survey engine is 
a single suggested FieldGroup. The constraints in the suggested FieldGroup system 
consist of FieldGroup levels (or priorities) and defaults. The survey wizard prioritizes 
the related FieldGroups by first selecting FieldGroups that possess the highest level 
(or priority) as defined by a level document for the particular wizard or broad goal. 

15 Each FieldGroup is assigned one and only one level per wizard. Each level is assigned 
as a positive integer value to a FieldGroup, with lower levels constraining FieldGroups 
to appear eariier in the survey, and higher levels constraining the FieldGroup to appear 
later in the survey. This ensures that certain FieldGroups appear at or near the 
beginning of the survey, and other FieldGroups appear at or near the end. 

20 Additionally, the level document also groups FieldGroups together in each level, and 
assigns one FieldGroup from the group as a default FieldGroup, so that if an 
administrator wanted to ensure that at least one FieldGroup out of a group of 
FieldGroups is always asked, it is asked if no other FieldGroup from that level is 
asked. For instance, there may be two separate FieldGroups, "Job" and "Position." 

25 Position may be a specialized type of job, which is appropriate to ask in certain 
industries, such as for a professional baseball player. In that case, job need not be 
asked because that information is captured in the position Fieldgroup. For the most 
part, most profiles only need to answer job, whereas in specialized cases, they may 
need to answer alternate FieldGroups such as position. Therefore job and position are 

30 grouped^ and job is set by an administrator as the default FieldGrbup'because the 
system requires that if people do not answer any other job-like question, they must 
answer job. 
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The weighted values on the Popular FieldGroups triplet are stored in a relational 
format. The weights represent each FieldGroup's popularity. This is defined as the 
number of profiles for each affinity group that have answers for that FieldGroup. 
Popularity is calculated by tallying up, for each FieldGroup, the number of users who 
have answered that FieldGroup. for each affinity group, and an association between 
an affinity, a FieldGroup, and a popularity, is stored in a relational table. By this 
mechanism, a feedback loop is created between the user's profile questions and 
answers, and the survey wizard. As user profiles are entered into the system via the 
survey process, new associations of similar profiles are produced and those results 
are integrated into the popularity of each corresponding Fieldgroup, yielding a 
subsequently more and more precise survey for differing types of job profiles. 
Additional flowchart discussion is provided be\ow. 

Constraints are generally applied to the system based upon naturally occurring 
relationships between FieldGroups, as they pertain to job profiles in general. For 
example, it is assumed that the existence of certain FieldGroups presupposes other 
FieldGroups. A human administrator with expertise in the domain defines these 
relationships based upon domain knowledge. Because the number of relations 
between FieldGroups is far fewer than the number of unique survey possibilities, it is 
efficient for an expert to define these relations, even if there are hundreds of 
FieldGroups. For instance, a FieldGroup such as "Bar Association" (generally used for 
lawyers and profiles requiring a legal degree) is only asked if the user's "Job." or 
perhaps their "Industry" is known, but It Is pointless to ask that FieldGroup if only the 
user's "Gender' is known. As such, a FieldGroup such as "Bar Association" is related 
to "Job" and "Industry." but not to "Gender." Relations such as these are referred to in 
the system as "FieldGroup Related," and are stored in the system using a relational 
format. In addition to the levels, these relations act as constraints on the determination 
of the output of the suggest FieldGroup. 

Given the constraints and weights that are resident in the system, the survey engine" 
selects amongst all the FieldGroups available for the survey, the FieldGroup that is the 
most popular (or highest weighted) FieldGroup among the affinity groups to which the 
user belongs, constrained by the levels and FieldGroup relations described previously. 
Finally, the FieldGroup is fonwarded to the to the user for presentation. The user 
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answers it, and the process is repeated for subsequent questions. If, after Iteration, a 
FieldGroup no longer can be suggested that meets the criteria discussed herein, the 
system mailcs the users survey as complete and takes a pre-defined next action, such 
as showing a message to the user and moving on to the reporting aspects of the 
system. 

Reference is now made to Figs. 9-10 that show a non-limiting example of the system 
suggesting popular answers for a FieldGroup in the survey. A mechanism exists in the 
system, which suggests possible answer choices for a particular FieldGroup, based 
upon several factors. These factors are, for example the FieldGroup being asked, an 
answer relations document, the user's profile and associated affinity groups, and a set 
of weights, which store the most popular answers for a particular FieldGroup. Just as 
there is a relational basis between FieldGroups asked during the survey process, one 
aspect of the survey engine establishes a relationship between a particular FieldGroup 
and the suggested answers. A particular FieldGroup is answer related to another 
FieldGroup if the answer to the first FieldGroup causes popular answers for the 
second FieldGroup to be suggested. 

The 'suggest popular answers' algorithm is constrained by the answer relations, and 
the answer values are weighted using a table consisting of a list of associations 
between a value, an affinity group, and the number of profiles who have answered that 
particular value. Among the constrained answers, the survey engine selects the X 
most popular (most highly weighted) answers among the list, where X is an integer 
defined by an administrator as a reasonable number of values to display for a user to 
select from. 

For example if a survey begins with a FieldGroup for Industry, and the FieldGroup is 
displayed, which asks the user about the Industry they work in, and they respond 
"law." a second FieldGroup for Law Firm, based on the process described eariier for 
suggested questions, is displayed and asks the user with which law fii-rh they are 
associated. Based on the Suggest Popular Answers algorithm, the engine can also 
provide a list of law firms that were previously provided by other users to this 
FieldGroup, based on those who also identified themselves in the law Industry. The 
affinity group Industry = "law" is, therefore, answer related to the FieldGroup for Law 
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Firm because the suggested answers for the FieldGroup Law Firm are related to the 
answer provided by the first FieldGroup Industry. Correspondingly, for the FieldGroup 
Law Firm, the system looks up all other FieldGroups that are answer-related to it. For 
example, the type of job (FieldGroup for Job) may be answer related to the affinity 

5 group associated with law firms, as may be the FieldGroup for "total hours billed per 
year," etc. Therefore, because FieldGroup Job may be answec-related to FieldGroup 
Industry and FieldGroup Law Firm, the system suggests to the user to select his type 
of job from a list that includes corporate attorney, litigation attorney, paralegal, and so 
forth. While, if the user had answered "Computer Software" for the FieldGroup 

10 Industry, then the system would have suggested different possible answers for 
FieldGroup Job, such as computer programmer, senior software engineer, IT support 
technician, etc. Alternatively, instead of using the suggested popular answers, the user 
may enter a new value, and Input a job title that is completely new to the system. 
Based on the user's responses, the system categorizes the users profile and aligns it 

15 with profiles that possess similar characteristics. 

When the survey wizard displays a question, one aspect is to determine if the 
FieldGroup is an open FieldGroup, supporting open-text answers. An open 
FieldGroup is one that allows for free text entries by a user, as opposed to a closed 

20 FieldGroup, where a user may only select values from a list or use numeric answers. 
If the FieldGroup is in an open format, the user may type a open-text answer, or select 
a suggested popular answer as described previously. When the user has made their 
entry, the system determines if the answer was typed as open-text or selected from 
the list of possible answers. If the answer is selected from a list of suggested answers, 

25 the users choice is saved in a database using the existing Answer ID for that existing 
answer in the system. If the answer was free/open-text, an algorithm is invoked to 
determine if the answer already exists in the database in a similar form to the users 
free-text entry. Using search technology, possible existing alternatives from the 
database are suggested that possess similar characteristics as the free-text answer. 

30 The alternative responses may possess different spelling of key words, gramhiatical 
variations, or combinations of other synonymous words. By doing this, the survey 
wizard tries to identify the underlying focus of the new answer and ensures that the 
system is gaining the right perspective from the user. If the user rejects the suggested 
alternatives, the system requests that the user retype the answer to confirm the 
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response, and possibiy enter more information about the answers, so that the system 
or an administrator may categorize the new answer. Once the user confirms the 
response by typing it a second time, the new answer is saved in the database and it 
becomes one of the possible answers that subsequent users may choose. 

5 

An administrator, or automated program, can also verify that any new answers are 
qualified values, such as not containing swear-words or other anomalies. An 
automated program may exist which uses a dictionary, or other software that can verify 
the validity of the value. If instead of a new open-text answer, the user selects one of 

10 the alternative responses, the selected answer is saved in the database using the 
existing Answer ID for that answer. Occasionally, the FieldGroup presented to the user 
is not of an open format, such as a small list of possible responses that do not change 
(are not open), or a numeric value, such as a salary figure, or a date, or Boolean 
values such as Yes/No. In numeric or date situations, there are bounds defined as well 

15 for answers. If the answer to the FieldGroup fits into the bounds of the FieldGroup 
definition, the user's response is saved in the database. For instance, if the user is 
answering a date field, the date may be required to be within a certain range, or if a 
salary, it must be greater than '0.' If the answer to this closed form of FieldGroup is not 
within the bounds of the FieldGroup definition, an error message is sent to the user 

20 asking for clarification or re-input of the answer. Ultimately, the users profile is saved 
and cataloged in a database that allows the system to correlate it with other affinity 
groups and other user profiles to provide a cornprehensive compensation report. 

Reference is now made to Fig. 16, where a flow for a profile search is shown. A major 
25 aspect of the invention concerns comparing an individual profile to all other profiles in 
the system, and determining which of these profiles are most similar. The Profile 
Search algorithm returns a list of similar profiles. This similar list of profiles are then 
summarized and aggregated into a readable report that offers a complex analysis of a 
user's compensation and career opportunities. This functionality allows the system to 
30 return an in-depth, customized" report consisting of analysis of sihriilar profiles in real 
time. It represents a more accurate picture of a user's compensation than a broad 
survey could, or one done by human analysts, or based only on job titles, or a 
standard expert system, etc. The Profile Search algorithm runs, which returns a list of 
profiles to which the user's profile matches most closely to the search goal. Profiles 
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are retrieved from the database as a set of FieldGroup,Field.AnswerValue triplets. The 
system encapsulates and defines similarity between profiles by use of a scoring 
mechanism. The scoring mechanism is generic in nature, and can apply to any 
attribute of a profile that has been defined in the system. It is important to note that 
different types of similarity can be established by the system. This allows different 
search goals to be executed. For example, a user may wish to know what projected 
salary they may expect to make in the marketplace, in their particular occupation, with 
the all other attributes, such as experience, location and industry, being similar. This is 
a common scenario for individuals wishing to switch jobs. The invention supports this 
type of analysis using a pre-defined search goal document, which specifies that the 
user's profile is to be' txsmpared io a set of pix^les^ahsrt/hai?^ #n|feri^^^ same : 

area, industry; etc; In anbthe^^^^^^ 

jdl3s^pwhich^h^y'm#be^u^^ giviprtlfeir skill^i ex^^ :ln thiis ■ 

jdgise^.d'^^J^®?''?^^?^ 

Reference is ndw/made td Fig. i 5 \/vhe^^^ scoring systeni is shown. To ] 

eric^p^ulatejeach" 

i«laiti0na|n5tftjctdre, us% 

(^xkct msltch^s a^^ 

ialth6uihv&opr<Ml ioWef than 'exa^^^^^^ 

€flldw;for a wide ■yari^^ of%im ^ ; 

mbre nafU^^ 

incarnations of occupati6n#r(^^ rnatches, and heri^^^^^^ 

lose much of their valued because a large percentage of real wprid profiles tKat ami 
Similar do not usually have values with exact matches, or the number of true variafiohsV 
is much higher than is usually accounted for in fixed reporting systems For instance,; 
an IRS auditor may wish to be compared to an apcouht^nt. bul because they have i 
different job titles, they rriay never be compared in other systems In thisj 
implementation, affinities (sis described elsewhere) are constantly being added and! 
updated through manual and automated~processes, which can link these valuei ' 
together, arid hence, retuifi similar profiles- 

•When a profile seareh js requested^ the search goal definition document for the seiarch 1 
is Tetriev&d. lit specifies r-jrule^ for how profile attributes are to be matched -^aiid; 
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eompared. The user's profile is then compared to/ajl other profiles in the system.: and, 
ieachT matching Value from the profiles is assigned.s^a score determined by the field' 
which it matches on. For instance, exact maitches on the Fie^^ 
a certain relatively high score.; An affinity match /.e: "All People with Accp 
5 is also considered bebau^ these matches are similair. but not exactly the same: ^ 
Because of this, these nriajches>re given a sljghtly lovver score. Each profile isi^^^^ 
Scof^a based -on ;^ is^ tqtaled^up J3^i 

surrimii^^ sbpres j. Q^^^ the jatt:Gan:;und<^^^^ that many i 

jdifferefht types iof siearch gpals^^a^^ 
10 type Df FieldGroup,/^ just qne;;kiild. For example^ ^b|^r; 

m^feh scores can, be>d^ 

jAirith scores ^^fo^^ create yerv^ aogurate :rS^ 6f profilgg M 

jtb:nniefet a search ^gosd^ be returned for a search (qualify), a profile must meet 

a certain overall threshold score, which is predefined by an administrator as part of the 

15 search goal document. Additionally, the profile must contain matches on specific 
deterministic fields. The threshold score removes any profiles that do not match on 
enough attributes to be considered a high quality match. For instance, it is possible 
that a profile matches on many non-deterministic values, such as gender, geographic 
location, or experience level, but does not match on something that is critical (or 

20 deterministic), such as job type or specialty. An accountant may live next to an 
attorney, in the same age range, in the same community, who went to the same 
college, but they should not be considered matches because they are in different jobs 
and different job affinities. Therefore, in one type of search goal, only certain fields and 
affinities, such as those related to the job or specialty, are considered deterministic 

25 enough to be considered for matches. Again, one skilled in the art will understand that 
while Job and Skill are considered highly deterministic for basic compensation 
analysis, the system could be employed for other types of analysis where possibly 
other FieldGroups, such as Location or Gender, might be specified as highly 
detemiinistic instead. This allows for the definition and automation of many kinds of 

30 reports meeting many different profile search goals. 



Additionally, some combinations of attribute matches may be considered more 
valuable than other combinations. For instance, it may be preferable to match a 
smaller subset of profiles for which a location is closer to the target profile. By 
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employing matchgroups within the profile search goal document, sets of matches can 
also be ranked. This is useful, for instance, in ranking profiles higher where geographic 
proximity is desirable. By creating a set of affinities (described elsewhere) that group 
together profiles by regions, the profile search system using matchgroups targets 

5 profiles within local regions first, ranking them higher than profiles that meet other 
match criteria but are in outlying regions. For instance, the search goal may first only 
find profiles in the same or surrounding cities. By defining metropolitan region affinity 
groups, one can find people in the same metropolitan region. Howeverj there may not 
be enough valid data in the system to find profiles in the same metropolitan region, 

10 and therefore, one must also consider profiles from a larger surrounding region, such 
as a state, or multi-state area, and choose them If necessary. By including affinities in 
a ranked fashion in matchgroups, it is possible to return profiles that are closest to our 
own by having them rank the highest. One skilled in the art would recognize that 
closeness could apply to any attribute of a profile in addition to location, such as 

15 experience level or age ranges. 

Reference is now made to Fig. 14 where another aspect of the invention, a set of 
profiles (usually but not necessarily retrieved via the profile search subsystem 
described elsewhere) is aggregated and their individual attributes are automatically 

20 summarized into calculations, such as averages, medians, standard deviations, and 
counts. The calculations are aggregated for fast real-time retrieval. Aggregate 
definitions define dimensions (such as skill) and measures (such as salary) Into an 
aggregate (such as average salary by skill). Additionally, the system can summarize 
values into predetermined ranges, such as salary ranges or age ranges. A report chart 

25 fprrnat defines how charts are displayed to an end user/ Many different formats, such 1 
ias HTML, PDF or JPEG, exist, and the repbrt output format may be adjusted to Wo;r1< : 
with any of these fqfrhats, and t charts rhay be displayed as bar chartsi pie bhartSi :! 
etc.; 

30 An administrator defines an aggregafe^^^ for exanhlsie iii a^^^ 

consisting:©? rneasure and a.. dimension and a name. Each aggl-egate is , calculated j 
over an affinity group or groups! For exampile, after a profile search; is executed, the Hstl 
pf resultarit profiles is cohibined into an affinity group, such as "People'M.eetihg Sea^^^ : 
Goal X fbr User Y," a^^ .ayai.labte report definitidris are executed, fesuiting^^n 
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numerous aggregatiorjs. Each aggregate deifinitjpn must contain a measure or , a 
dimension, or both If no measure is specified, the aggregate is calculated as a courit i 
over the entire dimension. If no dimension is specified; the average, 25th, 50th. 75th 
median, standard, deviation- and stand error, etc; are calculated, over the enti^^^^^ i 
5 population using standard algoi^ithrTis. Aggregates for an^^^ 

Calculated using this n1ethbdl;^^U allows fast-retrievar of aggregate ! 

information, and easy>d^finitiori of new aggregations, .^whic^^ are available to: any . of : 
thousandis^fafffini^ 

10 Because hundred^ of aggregate -y^finit ov^r thousands 6^ affinity^/ 

groupis,: it is jmpogsible to present ir^ a;for^ 

could easijy iind 'q uickiy'^^^u Abecatise^ thfe^j^^ 

thouskrid of pages, To sdiyeCthis iny^nlkii^ 
charts and griiupsriand filfe^^ charts? in ^aMayt^ 

1 5 understandable. ahdSvUse^ ^iG)5:a Jiuma that haVe^enpUg h^ data>^^ 

fchafts fthatt; are deterhniirtjid to be applicable to the user^s prp^ to thje: ijser^ 

TStis. allows fdir^^^ 

anytime-" without h^ to predefin^ a j report '^ny^part^^ 

!gjr^ijp!'harned " ^"i^yers^ by i 

20 ^ipbf ; "A#rage^alary^^ By^^Praelice Area." "Av^ Salary: By iTeachii^^^ 

TWeragie Sstla^ $ldll^'^Ayer^ S&lany^By Rate^^ 
Bar AssoGiaftiidrii^^ 

bh the applicability to thp user's prt)file.; ■ J^br iex^ "Ayerage^alai^;^ 
Teaching Rank'' is hot disf>layed 
25 named "Geographic Outlook" iriight contain charts such as *V?yverage Sallary^^^ Qity;" j 
or' *7Vverage Salary By Stated" 

Charts are grouped into logical sections that are recognizable to a human, and the ! 
system renders the charts in a grouped layout, so as to be in .an ; understandable;^^ 
30 :cbhesive7 readiable presisntation. For a particular set of similar prpfiies- ffi^ 
charts that are defined according to a report specification. j:A :^^ 
combined into a group which is then parsed and formatted by a prpgram into a user ! 
readable fpfrriat, such as HTML. 
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F6r^ instance, a lawyer's profile may have . matched to many other attornieys, . all who : 
have answered a FieldGroup for Bar AssoGiatipn and a.Field<3roup for Hburty B^^^^^ 
Rate. Thexpmpiled report for the lavvyer can autpm#caliy show a cf)art for ^Average ; 
Billing Rate by Bar Association," whereas a report for a High School Teabhers would i 
5 libt. shovv this chail because no profiles have either answered the "Bar ; 

AssqciatipnVFiel^ or: the nHpurly Biljing Rate" FieldGroup: This is^n important ■ 
)hnb;^atibh over previous approabhtes. which, a^^^^ returnjng genencj 

ass^ssrnehts thatgrbup individuii&tbi large, «^ tiseiess, categprizations- ign^^ 
subtler,'yet far more useful Gategorizatipns.: 

10 

Reference iis now made;to;Fig. :1]81iW^h^^^^ 

engine is^lset up ?to process pirbfilef d^ta;^iu^^^ '<ii?nin^ib.n%:f^^ 
ll^bfemsi and fault^^^ sysfem di^^^neiih^^:^ 

on the domain. Because the; suiv^^ 
1 5 user input, as vvell as freely input numeric dat% in pjace to autprn^tiGallyJ 

moriitorthait diata for ya^^ 
ajlbws ah adnrtiri 

instahce- a4js^r rniay enter data that is obyibusly bpgus'v^ ia^jhayin^i^^isala^^^^^ : 
too; High, pr?tpo fow for the currency Ijj^^^ '0,* AISo,lin sPjTi^ca^^^ 

20 the rUle^. engipe^may alsoMqtoma^^ ghanges'tp.prbjile^^ 

jh^ rulps engini3CIS;irnp^^^ aicsPf Wda^^ 

and Stored procedures that c^mparp^tHepr^^ 

take some action as a result. Each of these queries is- run agaiitsitvpac^^^ 
25 input intP the system by users, ahd/^the ehgipe quenes.; indud a ; 

list of changes determined by the rules, are stored in a table l The rules engiheVallpws i 
.istored procedures to be set up which ^c^ for any type Pf data error: i 

Another example of a rule is if a user enters tpo many Values for a piarticular i 
30 FjeldGrpUp •SkllL If a use'Fhas answered top /many ^~k^^ chances are tfiat^ 

some of- thos^,; skills arcr^ is just j>laylng with the isysteriri,>rid 

hence, the profile is invalidated, and notcpnsidered for profile searches and i:epprt^^^^^ 
fl^g on the profile marks a prpfife astactive or inactive. Inactive prptjl^: are iobtu^d^ 
any othec part pf .thb sys.tpm foi^^c^^^ including compan|pfiis'in' the,si^^^^ 
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engine, search goals/ or reports. This yvay, data are cleaned and maintained :^s 
statistically valid. Many other flags are also set on a profile, and one skilled. in- the. art 
can easily recognize that these flags are usefuj ways to^gauge profiles' use in various ; 
aspects of the system. Rules iri this form can aisp be used to modify existing profiles ! 
5 for data entry mistakes,. For instance,; a user may cqrnmpnly enter a_ new open^ext \ 
value for one FjeldGroup tHatijs jtruly, a value for _anotherf ^ .keep. data as ! 

yaild as:p6ssible; system such; as this, the rules (enginejnbyes'^the answer;! 

iFrpm one; FieidGrpuj^^; to engine maiy; be^' 

eiderided Jo anysjtuatipn 

10 

!Referring.npw to Fligj; 2p^^^a^^ 
(hereinafter %pparatus^?is^S^ 

plurality^ of users- 1 2G by, rnearis Pf a nefiivprk i^O. A^cjient 1 20/ for exarhple crient>i26-i 
1, ni^:Jb!e?an/inyjvi^^^ thei/piiriipse jMi 

15 iestablishing ai perspiial rahking agaiihst, Pther users whi^^were ^ 

gy?paratus 1 1tf jpr tiaer pf;/a ; fepiripenisatiPn s^rvpy;; 

HTiplerrienlalipn 

wi§h to/estalillsh ^a^ 

^mbodirrieritpi^heMriyeritiii^ a^blieiiiy^p; ifpn^ imay: b^jinterfestej^^ 

20 in receiving Vreppri^^^^^^ 

iareyiously .ansWeredit^^ 

implisftientjatipfi of the ap^aratus^'i^ b^«uch;a^ leceiye aireppit of the i 

average salary pf a specific job iiuhctipn/ or a r^prt^bf the ayfei^^ s^^ 

ofsarheJ 

25 

The Apparatus 110 is connected to the users 120, for example client 120-1, by means 
of a network 130. The network 130 may be, but is not limited to. a local area network 
(LAN), a wide area nelwotik (WAN), or the worid-wide-web (WWW). Through the use of 
Web pages and standard communication protocols, a client 120 may easily access the 
30 apparatus ilO for both surveying and reporting purposes. In one embodiment, the 
apparatus 110 comprises a central processing unit (CPU) 112, a work memory 114, a 
code memory 116, and a database storage 118. The CPU 112 executes computer 
code stored, for example, in the code memory 116, and which enables among others 
the handling of the communication protocols between the apparatus 110 and the 
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clients 120, the display of Web pages, search of the content of the database, 
preparation of reports, and the like. Work memory 114 is used by the CPU 112 for its 
operation. The database 118 retains user profiles, a plurality of questions and 
corresponding answers, report definitions, affinity groups, periodic reports, and the 
5 like. 

Reference is now made again to Fig. 1. where the details of a Website implementation 
of the system 100 incoiporating the apparatus 110 are further discussed. There are 
three basic building blocks to the system: display components 210, business 

10 components 240, and data components 260. The display components 210 are handled 
by the client 120 and the apparatus (or server) 110. The client 120 provides the display 
capabilities by using a Web browser 220. The apparatus 110 provides the display 
capabilities through the use of the hyper-text transfer protocol (HTTP) 230. Display 
components 210 enable the visual display of a survey and reports as may be required 

15 by a client 120. The system 100 further comprises business components 240 which 
have core components 245 and support components 250. Core components 245 
comprise at least a survey engine 247, a search engine 248, and a reporting engine 
246. Support components 250 may include, but are not limited to, commerce 251, 
security 252, administration 253, and content management 254. Business components 

20 240 enable the system 100 to provide the survey and reporting services in accordance 
with the disclosed invention. The data components 260 are further comprised of a 
structured query language (SQL) server database 261, a full text catalog 262, and one 
or more extensible markup language (XML) configuration documents 263. These 
components provide the data as may be required for the proper operation of the 

25 system 100 and particularly the apparatus 110, in accordance with the disclosed 
invention. 

Returning to Fig. 20 it should be noted that other than Web browser 220 on client 120, 
all the other components described in Fig. 2 may reside on the apparatus 110. 
30 However, a person skilled In the art would be able to adapt the'disclosed architecture 
such that certain modification are made which provide for specific system 100 needs. 
For example, the database 118 may be distributed and accessible through the 
network 130. In another embodiment of the disclosed invention, a plurality of 
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apparatus 110 handle the surveys and have access to a plurality of respective 
databases 118. 

The code memory 116 contains, in addition to other codes, a code that is targeted for 
5 the matching process required for the purpose of matching a user to a plurality of other 
users and establishing the user's unique affinity group. In contrast to prior art solutions, 
the invention disclosed herein provides for a dynamic creation of affinity groups, in 
addition to the comparison to previously stored affinity groups. The advantage of 
automatically detecting and creating affinity groups is in the fact the multiple 

10 parameters filled out by the user as part of the survey allow for increasingly accurately 
assessing the affinity group or groups with which a user should be associated with. A 
user of the system is therefore able to match his profile to that of others such as 
himself, and determine, for example, an expected salary for a certain job description or 
geographic area. However, the method is not limited for job related surveys and these 

15 are provided merely as an exemplary and no-limiting usage scenarios. A person skilled 
in the art would further note that the methods disclosed herein below may not 
necessarily require the exemplary apparatus disclosed above, and such methods may 
be applied to user profiles and affinity groups provided from other means, automated, 
manual, or combinations thereof 

20 

In accordance with the disclosed invention, it is necessary to perform a series of 
matches between user profiles, for the purpose of providing customized reports. In one 
embodiment of the disclosed invention, a profile entered by a user is matched against 
a plurality of user profiles stored in the system. More specifically, the entered profile is 

25 matched to other profiles according to "matchgroups" (explained in more detail below) 
to determine if the profiles are similar, or like, each other. It is therefore possible to 
create a list of user profiles that are like the profile entered by the user, otherwise 
known as an affinity group. Using matchgroups, it is further possible to match a 
plurality of profiles against a goal, where a goal may be a set of parameters to which a 

30 subset of the plurality of user profiles matches best according to a defined score arid" 
score threshold. It is further possible to match an entered profile to one or more affinity 
groups having known characteristics. In one embodiment of the invention such 
matching is performed at every stage of the answers provided by the user as the 
survey questions are presented and responded to. In another embodiment, such 
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matching is applied after a completed survey, taking into account all attributes of the 
entered user profile, and producing a resulting group or groups of matctiing profiles 
according to the overall matching goal. 

5 In accordance with the disclosed invention a matchgroup may be defined as a plurality 
of match fields and a plurality of affinity groups, each (match field, affinity group, and 
matchgroup) having a score value. If the entered profile has values matching other 
profiles' values according to the matchgroup, the matchgroup score is increased by the 
score value defined for the matching field. If the entered profile has values matching 

10 within an affinity group, the matchgroup score is increased by the affinity score value. 
The plurality of scores is tallied, allowing the determination of an overall score for the 
matchgroup. Furthermore, the process is repeated for any number of defined 
matchgroups having potentially different match fields and affinity groups, allowing the 
determination of an overall score for a defined goal. Matching profiles may be then 

15 included or excluded depending on threshold score values defined for this purpose, 
such as "Excellent Match," "Good Match," or "Bad Match." The process of matching is 
hereinafter described in greater detail. 

Reference is now made to Fig. 21, where an exemplary and non-limiting flowchart 300 
20 for the purpose of creating a user specific affinity group is shown. In step S310, a user 
profile is received (hereinafter the "received user profile"). This may be a user profile 
that was prepared based on an automated survey system, discussed in more detail 
above. In step S320 a score is associated with each of the possible match groups as 
shown above. A match group has a plurality of fields, affinity groups, and respective 
25 weights or scores, which allows for combinations of attribute matches, may be 
considered more valuable than other combinations. For instance, it may be preferable 
to match a smaller subset of profiles for which a location is closer to the target profile. 
By employing matchgroups within the profile search goal document, sets of matches 
can also be ranked. This is useful, for instance, in ranking profiles higher where 
30 geographic proximity is desirable. By creating a set of affinities designed to relate 
profiles by regions, the profile search system using matchgroups targets profiles within 
local regions first, ranking them higher than profiles that meet other match criteria but 
are in outlying regions. For instance, the search goal may first only find profiles in the 
same or surrounding cities. By defining metropolitan region affinity groups, user 
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profiles of people in the same metropolitan region can be found. However, there may 
not be enough valid data in the system to find user profiles in the same metropolitan 
region, and therefore, user profiles from a larger surrounding region, such as a state, 
or multi-state area, can be considered. By including affinities in a ranked fashion in 
matchgroups, user profiles that are closes" to compared to user profile may be located, 
such located user profiles having the highest score ranks. One skilled in the art would 
recognize that closeness could apply to any attribute of a profile in addition to location, 
such as experience level, job category, company type, age ranges, and others. In step 
S330, a search is performed matching a plurality of user profiles to that of the received 
user profile. As a result of the search, a fist of scores is returned for each of the 
compared user profiles. In one embodiment of the invention, the list is returned 
ordered from the highest to Vne lowest score. A more detailed description of the search 
process is provided below. In step S340, any number of score fitness ranges is 
assigned, for example, a score range defining an excellent fit, a score range defining a 
good fit. and a score range defining below acceptable fit. More specifically, if the score 
is from '0' to '100" then excellent fit may be scores of '90' through '100,' good fit having 
scores of '70' through '90.' and so on. In step S350, a report of the profiles best fitting 
the received user profile is provided, identifying those profiles that best fit as a new 
affinity group. In another embodiment of the invention, the created affinity group is 
checked against the already existing affinity groups and, if there is a match, no new 
affinity group Is created. An advantage of the disclosed invention over prior art is in the 
creation of an affinity group, which includes at least the received user profile. This 
allows for a larger match scope than the static assignment of an affinity group 
commonly found in prior art solutions. A person skilled in the art may modify the 
disclosed flowchart to fit with the needs of specific programming languages, e g. C++, 
or description languages, e.g. XML, without departing from the scope of the disclosed 
invention. 

Referring to Fig. 22, an exemplary and non-limiting flowchart of step S330 of Fig. 3 for 
the profile search process is shown: The flow chart explains the seiarch arid matching 
process of step S330 discussed in Fig. 3 above. In step S330-10 a user profile to be 
matched to the user profile received in step S310 is selected (hereinafter the "selected 
user profile"). The selected user profile is one that was not previously selected during 
the specific execution of the current search and matchgroup. In step S330-20, the 
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match group score of the selected user profile is determined in comparison with the 
received user profile. The match score may be a binary value, for example, '0' 
meaning no match and '1' meaning match. It is also possible to have a sliding degree 
of fitness with multiple fitness score values, for example, '0' = no match, '1' = bad 

5 match, '2' = acceptable match, '3' = good match, and '4' = excellent match. The 
specific match score is correlated further with the score value lhat is indicative of the 
weight a certain match field may have. As noted above, certain match fields may have 
a higher importance for the overall score than others, and hence have a higher score 
value, or effect, on the overall score result It is further possible to limit the score, for 

10 example to a maximum score, for any matchgroup, so that a multitude of matches of a 
particular field do not skew the overall match score. In step S330-30, it is checked if 
more match fields within the same user profile are to be checked and if so execution 
continues with step S330-20. Otherwise, execution continues with step S330-40. In 
step S330-40, an overall fitness score respective of the user profile in comparison to 

15 the user profile received in step S210 is calculated. This is a weighted value that takes 
into consideration all the relevant matchgroups. The overall result is used as a score 
indicative of the level of fitness between the two user profiles. In one embodiment of 
this invention these scores are normalized, for example, '100%' meaning a best fit and 
•0%' being no fit. 

20 

A matchgroup may be classified as being deterministic or non-deterministic, and 
requiring at least one detemiinistic match to exist within the overall score, thus 
allowing a more deterministic match than solely a weighted fuzzy type of result. For 
example, a matchgroup designated for 'Job Type' could be marked as deterministic. 

25 and then no profile is included In the overall affinity group unless there is at least a 
score, which may also require to be at least above a predefined threshold value, given 
to the Job Type matchgroup for the profile. Consequently, any score in a non- 
deterministic matchgroup could serve to increase the overall score of a profile, but in 
this case cannot by itself be sufficient to allow the profile to be included in the final fit. 

30 One skilled in the art would recognize that parametiers such as this can be considered 
optional in different uses of the system, and are not meant to be limiting, but providing 
further flexibility. 
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In yet another embodiment of the disclosed invention it is further possible to score on 
ranges of values rather than by an exact match. For example, a matchgroup can 
define a match field for Age Range, having defined ranges of Less than 17, 18-29, 30- 
45, 45-64, and 65+. If the entered profile matches by range with any user profile to be 
5 compared, the user profile could receive a score for such a matchgroup. It is also 
possible to score based on other Boolean criteria, such as a match field existing in a 
profile and having any value at all, as opposed to not existing in a profile. It is further 
possible to limit matches by a fixed criteria, such as only to allow for matches with 
profiles constrained to a particular arbitrary date range. 

10 

In step S330-50, it Is checked whether there are more user profiles not yet matched 
against and if so execution continues with step S330-10. Otherwise, execution 
continues with step S330-60. In step S330-60, a report including the score results of 
the user profiles to which the user profile received in step S310 was matched against 

15 are provided. These results, for example, may be used for the purpose of reporting by 
the apparatus 110 discussed in more detail above. The survey apparatus 110 uses 
this list to determine the affinity group to which a user belongs andto prepare tailored 
reports based, at least in part, on such an association to an affinity group or the 
determination of affinity groups as discussed in more detail above. A person skilled in 

20 the art may modify the disclosed flowchart to fit with the needs of specific programming 
languages, e.g. C++, or description languages, e.g. XML, without departing from the 
scope of the disclosed invention, or further be able to use it on an apparatus other than 
the one described as the apparatus 110. 

25 Reference is now made to Fig. 23 where an exemplary and non-limifing extensible 
markup language (XML) code for profile matching is shown. The code may reside in 
memory code 116 of the apparatus 110, Lines 504 through 507 provide information of 
filters to be applied on the search data. This may include filters such as the state or a 
country in which a user is located or in which the user wishes to be. Another filter may 

30 be the profiles to be searched which can include all the profiles available, or a isubset 
thereof Lines 508 through 514 define sources for user profiles. Such sources may be 
available on database 118. Such sources may be affinity groups created by apparatus 
110. Lines 516-522, 523-527, 528-532. 533-537. 538-541, 542-548, 549-552, 553-557. 
558-561. 562-564, 565-567, 568-577, 578-581, 582-585, 586-590. and 591-594 are 
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examples of matches performed in accordance with the disclosed invention, as made 
applicable to an XML implementation. Lines 595-598 define the ranking ranges so as 
to allow for the grouping of the matching profiles in accordance with the disclosed 
invention. A person skilled in the art may modify the disclosed code to adapt to other 
5 types of searches for the purpose of matching user profiles without departing from the 
scope of the disclosed invention. 

Referring to Fig. 24 an exemplary and non-limiting flowchart 600 for the matching of a 
user profile to an affinity group, is shown. In step S610, an affinity group to be matched 

10 to a user profile, for example the user profile received in step S310 shown in Fig. 3, is 
selected. This affinity group is one that was not matched before during the specific 
execution of the current search and match. The match process entails the 
determination of scores of match groups of the affinity group with respect to the 
received profile. In step S620, a match group of the affinity group and the received 

15 user profile are compared to determine a score. The score may be a binary value, for 
example, '0' meaning low and '1' meaning high. It is also possible to have a sliding 
degree of fitness with multiple fitness score values, for example, '0' = no match, 'V = 
bad match, '2' = acceptable match, '3' = good match, and '4' = excellent match. The 
specific score may be further weighted based on the certain match group used. For 

20 example, the match group of location may have a higher weight than that of a job 
position. In step S630, it is checked if more match groups between the affinity group 
and the received user profile are to be checked and if so execution continues with step 
S620. OthenA/ise, execution continues with step S640. In step S640, an overall fitness 
score respective of the affinity group in comparison to the user profile is calculated. 

25 This is a weighted value that takes into consideration all the match fields compared 
and their respective score values. The overall result is used as a score, indicative of 
the level of fitness between the affinity group and the user profile. In one embodiment 
of this invention these scores are normalized, for example, '100%' meaning a best fit 
and *0%' being no fit In step S650, it is checked whether there are more affinity groups 

30 not yet matched against and if so execution continues with step S610. Otherwise, 
execution continues with step S660. In step S660, a report including the score results 
of the affinity groups to which the user profile was matched against are provided. A 
person skilled in the art would be able to extend the apparatus 110 to provide the 
necessary reports by, for example, including the required code in code memory 116. A 
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person skilled In the art may further modify the disclosed flowchart to fit with the needs 
of specific programming languages, e.g. C++, or description languages, e.g. XML, 
without departing from the scope of the disclosed invention. 

5 Reference is now made to Fig, 25, where an exemplary and non-limiting flowchart 700 
for reporting of results of a matching process is shown. Such a-report may be provided 
in response to a goal setting as described above, and in more detail in a U.S. patent 
application entitled AUTOMATED COMPENSATION REPORTS USING ONLINE 
SURVEYS AND COLLABORATIVE FILTERING, Serial Number (unknown), filed on 

10 the same day and date, assigned to common assignee, and which is hereby 
incorporated In its entirety by this reference thereto. In step S710, a user is asked If an 
extended report is desired and, if so, execution continues with step S730. Otherwise, 
execution continues with step S720, where a standard report is generated and, 
thereafter, execution continues with step S750. The report is generated based on the 

15 user profile and the respective affinity group associated with that user profile 
generated by the matching system. In step S730, billing information is received from 
the user, for example client 120-1. Such information may include, but is not limited to, 
a purchase order (PO) number, a credit card number, or a debit card number. In step 
S740, an extended report is generated, the report being based on the user profile and 

20 the respective affinity group associated to that user profile. An extended report may 
provide additional information otherwise not made available to the non-paying user. 
Specifically, such extended reports may include reports of a statistical nature 
respective of a plurality of users. This is the case where a human resource manager 
wants to find out certain statistics about compensation demands common in a certain 

25 geographical area. In step S760, the extended report or the standard report, as the 
case may be, is sent to the user, for example by means of displaying it as a Web page 
on the terminal of the client 120, as an e-mail attachment, and the like. In another 
embodiment of the invention the client 120 may further provides report parameters that 
influence the desired output of the report, for example, the type of Information to be 

30 displayed, the manner in which such information is provided, and the like. Such " 
information may be provided by means of defining goals as described in greater details 
in the above mentioned U.S. patent application. 
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Although the invention is described herein with reference to the preferred embodiment, 
one sidlled in the art will readily appreciate that other applications may be substituted 
for those set forth herein without departing from the spirit and scope of the present 
invention; Accordingly, the invention should only be limited by the Claims included 
below. 
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1 . A method for surveying a user, comprising the steps of: 

presenting at least one question to said user, said at least one question 
5 being pertinent for detemiination of at least one affinity group to said user; 

creating a user profile for said user based on said user's answers to said at 
least one question, wherein said user profile is comprised of said at least one 
question and at least a corresponding answer; 

adding said user profile to one or more affinity groups; and 
10 storing said user profile. 

2. The method of Claim 1 , wherein said question is comprised of a set of one or 
more question fields that forni a logical grouping of questions into a single record. 

15 3. The method of Claim 1 , wherein said method further comprises the step of: 

presenting at least one additional question which is a result of said at least 
a question presented to said user. 

4. The method of Claim 3. wherein said at least another question is presented as a 

20 result of at least one of: 

popularity of said at least another question within said at least an affinity 

group: 

being a most frequently answered said at least another question within 
said at least an affinity group; 
25 being a most recently answered said at least another question within said 

at least an affinity group; and 

relation to said at least a question. 

5. The method of Claim 1 . wherein said at least a corresponding answer is an open 
30 text. ~ 

6. The method of Claim 5, wherein said open text allows said user to add a new 
answer to said at least a corresponding answer. 



wo 2004/061740 PCT/US200J/041413 

-34- 

7. The method of Claim 6, wherein said new answer is used as one of said 
respective answers when said at least as question is suggested. 

8. The method of Claim 1 , wherein said at least a question may have one or more 
5 possible answers displayed. 

9. The method of Claim 1 . wherein said user may select one or more answers to 
said question. 

10 1 0. The method of Claim 8, wherein said one or more possible answers displayed is 
based on at least one of: 

popularity of an answer within said at least an affinity group; 

being a most frequent answer within said at least an affinity group;and 

being a most recent answer within said at least an affinity group. 

15 

11. The method of Claim 1 , further comprising the step of: 

filtering said user's answers to said question. 

12. The method of Claim 1 1 , wherein said filtering is performed in at least one of real- 
20 time and batch mode. 

1 3. The method of Claim 1 1 , wherein said filtering further compries the modification 
of an answer to said question based on at least one of: 

predetermined criterion; 
25 one or more filtering rules; 

consistency with previously answered questions; 
consistency with all answered questions; and 
consistency with answers of at least said affinity group. 

30 14. The rriethbd of Claim 1 , further comprising the steps of: 
periodically creating a new affinity group; and 
associating at least a user to said new affinity group. 



1 5. The method of Claim 1 , further comprising the step of: 
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creating a new affinity group by a user. 
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1 6. The method of Claim 1 5. further comprising the step of: 

associating matching user profiles with said new affinity group. 

17. The method of Claim 1 . further comprising: 

the steps of providing a report. 

18. The method of Claim 17, wherein the generation of said report is constrained by 
at least one of an attribute of said user profile and a goal. 

19. The method of Claim 18, wherein said goal comprises at least one of: 

a profile attribute value; 

a range of profile attribute values; 

a Boolean value reflective of a set of values; 

a Boolean value reflective of a set of non-values; 

a date range; 

a minimum count of matching profiles; 
a maximum count of matching profiles; 
a question filter; and 
a match score threshold. 

20. The method of Claim 1 8, wherein said constraint results are weighted such that 
detemiinistic fields have a higher score then non-detemiinistic fields. 

21 . The method of Claim 1 8. wherein for the purpose of providing said report, said 
method comprises the step of matching to at least one ofsaid affinity groups at 
least one of a goal and a user profile. 

22. The method of Claim 21 . further comprising the step of: 

determining the best match. 



23. The method of Claim 21 . further comprising the step of: 
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determining one or more matches which are the best matches from a 
plurality of possible matches. 

24. The method of Claim 23. wherein said matches are arranged by order of match 
score, said order being grouped to at least two levels of matches, based on said 
score. 

25. The method of Claim 21 ^ wherein said step of matching further comprises the 
steps of: 

scoring of each match with said affinity groups ;and 
weighting the importance of including each said match in the aggregation 
of said report. 

26. The method of Claim 21 , wherein said step of matching to at least one of said 
affinity groups further comprises the steps of: 

classifying of each match with said affinity groups as being one of key in 
meeting said goal and ancillary in meeting said goal. 

27. The method of Claim 18, wherein said goal is one of a personal goal and an 
informative goal. 

28. The method of Claim 27, wherein said informative goal provides aggregated 
information pertaining to a plurality of user profiles. 

29. The method of Claim 28, wherein said aggregated information comprises at least 
statistical information. 

30. The method of Claim 27, wherein said report resulting of said personal goal 
provides a comparison of the user having said user profile to at least one of a 
plurality of user profiles and an affinity group. 

31. A method for a compensation survey of a user, comprising the steps of: 
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presenting at least one question to said user, said at least one question 
being pertinent for determination of at least compensation within an affinity group 
of said user; 

creating a user profile for said user based on said user's answers to said at 
5 least one question, wherein said user profile is comprised of said at least one 

question and at least one corresponding answer; 

adding said user profile to one or more affinity groups; and 
storing said user profile. 

10 32. The method of Claim 31, wherein said question is comprised of a set of one or 

more question fields that form a logical grouping of questions into a single record. 



33. The method of Claim 31 , wherein said method further comprises the step of 
presenting at least another question which is a result of said at least a question 

15 presented to said user. 

34. The method of Claim 33, wherein said at least another question is presented as a 
result of at least one of: popularity of said at least another question within said at 
least an affinity group, being a most frequently answered said at least another 

20 question within said at least an affinity group, being a most recently answered 

said at least another question within said at least an affinity group, relation to said 
at least a question. 

35. The method of Claim 31, wherein said at least a corresponding answer is an open 
25 text. 

36. The method of Claim 35, wherein said open text allows said user to add a new 
answer to said at least a corresponding answer. 

30 37. The method of Claim 36', wherein said new answer is used as one of said 
respective answers when said at least as question is suggested. 

38. The method of Claim 31, wherein said at least a question may have one or more 
possible answers displayed. 
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39. The method of Claim 31 , wherein said user may select one or more answers to 
said question. 

5 40. The method of Claim 38, wherein said one or more possible answers displayed is 
based on any of: 

popularity of an answer within said at least an affinity group; 

being a most frequent answer within said at least an affinity group; and 

being a most recent answer within said at least an affinity group. 

10 

41 . The method of Claim 31 , further comprising the step of: 

filtering said user's answers to said question. 

42. The method of Claim 41, wherein said filtering is performed in at least one of real- 
15 time and batch mode, 

43. The method of Claim 41, said filtering further comprising the step of: 

modifying an answer to said question based on any of: 
predetermined criterion; 
20 one or more filtering rules; 

consistency with previously answered questions; 
consistency with all answered questions; and 
consistency with answers of at least said affinity group. 

method of Claim 31, further comprising the steps of: ' 
periodically creating a new affinity group; and 
associating at least one user to said new affinity group. 

30 45. The method of Claim 31 , further comprising the step of: 
creating a new affinity group by a user. 

46. The method of Claim 45, further comprising the step of: 

associating matching user profiles with said new affinity group. 



25 

44. The 
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10 



5 



47. The 



method of Claim 31, wherein said affinity group comprises any of: 
profession; 
geographic location; 
compensation; 
compensation range; 
experience; 
experience range; 
position; and 
position range. 



48. The method of Claim 31 , further comprising the step of: 
providing a compensation report. 

15 49. The method of Claim 48, wherein the generation of said compensation report is 
constrained by at least one of an attribute of said user profile and a goal, 

50. The method of Claim 49, further comprising the step of: 

weighting said constraint results , whereindeterministic fields have a higher 
20 score than non-deterministic fields. 

51 . The method of Claim 49, wherein said goal comprises any of: 

a desired compensation; 
a desired range of compensation; 
25 a desired geographic location; 



52. The method of Claim 49, wherein for the purpose of providing said report, said 
30 method cornprises the step of: 

matching to at least one of said affinity groups at least one of a goal and a 
user profile. 



a desired firm; and 

a desired range of firms. 



53. The method of Claim 52, further comprising the step of: 
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determining a best match. 

54. The method of Claim 52, further comprising the step of: 

determining one or more matches which are best matches from a plurality 
of possible matches. 

55. The method of Claim 54, wherein said matches are arranged by order of match 
score, said order being grouped to at least two levels of matches, based on said 
score. 

56. The method of Claim 52. wherein said step of matching further comprises the 
steps of: 

the scoring of each match with said affinity groups; and 

weighting importance of including best match in an aggregation of said 

report. 

57. The method of Claim 49, wherein said goal is any of a personal goal and an 
informative goal. 

58. The method of Claim 57, wherein said personal goal is any of: 

compensation; 
compensation range; 
salary; 

salary range; 
geographic location; 
position; and 
position range. 

59. The method of Claim 57, wherein said informative goat provides aggregated 
information pertaining to a plurality of user profiles. 

60. The method of Claim 59, wherein said aggregated information comprises at least 
statistical information. 
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61 . The method of Claim 60. wherein said statistical infomfiation comprises any of: 

average compensation; 
average salary; 
median compensation; 
median salary; 
salary percentile; 
standard deviation; 
trend; 

profile count; 

most frequent compensation; and 
most frequent salary. 

62. The method of Claim 57, wherein said report resulting from said personal goal 
provides a comparison of a user having said user profile to at least one of a 
plurality of user profiles and an affinity group. 



63. The method of Claim 31 , wherein said compensation any of: 
annual salary; 
monthly salary; 
weekly salary; 
hourly rate; 
bonus; 
tip; 

benefits; and 
vacation time. 



64. A system for compensation surveying and reporting, comprising: 

means for accessing a Website, said Website being connected to a 
network; 

means for surveying a user for informatfoh pertinent for deterrhination of 
compensation; 

means for creating a user profile for said user based on gathering of said 
information, said user profile further comprised of at least one question and one 
corresponding answer; 
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means for storing said user profile; and 

means for nnatching an attribute of said user profile with at least affinity 
group, said affinity groups being previously stored in said storage means. 

5 65. A method for matching a user profile to a plurality of user profiles, comprising the 
steps of: , - 

receiving a first user profile; 

assigning a score value to at least one match group; 
matching said first user profile with at least a second user profile from said 
10 plurality of user profiles and assigning an overall fitness score; and 

reporting said fitness score. 

66. The method of Claim 65, wherein said score value is a relative weight of said 
match group. 

15 

67. The method of Claim 66, wherein said weight is proportionate to at least the 
Importance of a score value of said match group to the said overall fitness score. 

68. The method of Claim 66, wherein said match group is further comprised of at 
20 least one of match field and an affinity group. 

69. The method of Claim 68, wherein said match field comprises a score value. 

70. The method of Claim 68, wherein said affinity group comprises a score value. 

25 

71 . The method of Claim 65, wherein said match group comprises further one of a 
deterministic and a non-deterministic match group. 

72. The method of Claim 71 , wherein a score is determined for a profile only if there 
30 exists a match to at least said deterministic match group. " 

73. The method of Claim 65, wherein said matching comprises the steps of: 

a) selecting said second user profile from a plurality of user profiles not 
previously matched with said first user profile; 
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b) comparing a match field of said first user profile to a respective match 
field of said second user profile, and determining a match group score; 

c) repeating step b) until all match fields requiring a comparison are 
matched between said first user profile and said second user profile; 

5 d) assigning a fitness score to said second user profile based on the 

plurality of said scores determined in step b); 

e) repeating the method steps from step a) until all available user profiles 
are matched against said first user profile; 

f) reporting the fitness scores. 

10 

74. The method of Claim 73, wherein said step b) further comprises the step of 
matching at least one of a match field and an affinity. 



75. The method of Claim 74, wherein said fitness score is at least a tally of score 
15 values of at least one of a match group, a match field, and an affinity. 

76. The method of Claim 73, wherein said fitness scores of step f) are sorted by order 
of fitness. 

20 77. The method of Claim 76, wherein user profiles having a highest fitness scores are 
grouped into an affinity group. 

78, The method of Claim 77, wherein a number of user profiles is determined using 
any of: 

25 a minimum fitness score of a user profile; 

range of fitness scores; 

an absolute number of the user profiles; 

a defined percent of user profiles; and 

a date range of user profiles. 
30 , " • - 

79. The method of Claim 65, further comprising the steps of: 

receiving information of a type of report requested; 
if said report is of a type requiring receipt of financial commitment, then 
receiving relevant information; 
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providing the desired report. 

80. The method of Claim 79, wherein said receipt of financial commitment comprises 
the step of 

5 receiving any of credit card information, debit card information, purchase 

order information, coupon information, and check information. 



81 . The method of Claim 65, wherein said plurality of user profiles comprises an 
affinity group. 

10 

82. The method of Claim 65, wherein said fitness score is at least a weighted score of 
at least one of a match group, a match field, and an affinity group. 

83. A computer software product containing instructions for matching a user profile to 
15 a plurality of user profiles, the instructions further being capable of executing at 

least the steps of: 

receiving a first user profile; 

assigning a score value to at least a match group; 

matching said first user profile with at least a second user profile from said 
20 plurality of user profiles; 

assigning a fitness score to said at least second user profile; and 
reporting the fitness score of at least said second user profile. 

84. The computer software product of Claim 83, wherein said matching step 
25 comprises the steps of: 

a) selecting said second user profile from a plurality of user profiles not 
previously matched with said first user profile; 

b) comparing a match field of said first user profile to a respective match 
field of said second user profile, and determining a score; 

30 c) repeating step b) iintll all match fields requiring a cbnriparisbn are 

matched between said first user profile and said second user profile; 

d) assigning a fitness score to said second user profile based on the 
plurality of said scores determined in step b); 
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e) repeating the method from step a) until all available user profiles are 
matched against said first user profile; and 

f) reporting the fitness scores, 

5 85. The computer software product of Claim 84, wherein said step b) further 
comprises the step of: 

matching at least one of a match field and an affinity, 

86. The computer software product of Claim 83, further comprising the steps of: 
10 receiving information of the type of report requested; 

if said report is of a type requiring receipt of financial commitment, then 
receiving relevant information; and 
providing a desired report. 

15 87, A method for matching a user profile to at least an affinity group, comprising the 
steps of: 

receiving a first user profile; 

assigning a score value to at least a match group; 

matching said first user profile with said at least an affinity of said affinity 

20 group; 

assigning a fitness score to said affinity group; and 
reporting said fitness score. 

88. The method of Claim 87, wherein said matching step comprises the steps of: 
25 a) selecting said first affinity group from a plurality of affinity groups not 

previously matched with said first user profile; 

b) comparing a match field of said first user profile to a respective match 
field of said first affinity, and determining a match group score; 

c) repeating step b) until all match groups requiring a comparison are 
'30 matched between said first user profile and said first affinity; 

d) assigning a fitness score to said affinity group based on the plurality of 
said scores determined in step b); 

e) repeating the method from step a) until all available affinity groups are 
matched against said first user profile; and 
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f) reporting the fitness scores. 

89. The method of Clainn 87, further comprising the steps of: 

receiving information of a type of report requested; 
if said report is of a type requiring receipt of financial commitment, then 
receiving the relevant information; and 
providing a desired report. 

90. A computer software product containing instructions for matching a user profile to 
at least an affinity group, the instructions further being capable of executing at 
least the steps of. 

receiving a first user profile; 

assigning a score value to at least a match group; 

matching said first user profile with at least an affinity of said affinity ; 

assigning a fitness score to said affinity group; and 

reporting the fitness score of at least said first affinity group. 

91 . The computer software product of Claim 90, wherein said matching step 
comprises the steps of 

a) selecting said first affinity group from a plurality of affinity groups not 
previously matched with said first user profile; 

b) comparing a match field of said first user profile to the respective match 
field of said first affinity, and determining a match group score; 

c) repeating step b) until all match groups requiring a comparison are 
matched between said first user profile and said first affinity; 

d) assigning a fitness score to said affinity group based on a plurality of 
said scores determined in step b); 

e) repeating the method from step a) until all available affinity groups are 
matched against said first user profile; and 

f) reporting fitness scores, 

92. The computer software product of Claim 90, further comprising the steps of 

receiving informafion of a type of report requested; 
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if said report is of a type requiring receipt of financial commitment, then 
receiving relevant information; and 
providing a desired report. 



5 93. An apparatus for performing automated surveys, comprising: 

database means containing at least a plurality of prospective survey 
questions and prospective answers; 

memory means for storing code, wherein said code contains at least code 
to perform an automated survey using said plurality of survey questions and 

10 prospective answers, for selecting a questions and respective prospect answers 

based on at least a response provided to a previous question, code for creating a 
user profile, code for creating at least an affinity group based on a plurality of user 
profiles, and code for association of said user profile with at least an affinity 
group; 

15 computational means for executing said code; and 

communication means for communication with at least a user. 

94, The apparatus of Claim 93, said database means further comprising: 

at least one of user profiles database, affinity groups database, and 
20 reporting definitions. 



95. The apparatus of Claim 93, wherein said code to perform an automated survey 
selects one of said plurality of survey questions based on at least one of answers 
provided by said user, said user profile, and an affinity group. 

25 

96, The apparatus of Claim 93, further comprising: 

means for periodically executing said code for creating at least an affinity 
group based on a plurality of user profiles. 

30 97. The apparatus of Claim 93, wherein said apparatus further compriisies: 
means for providing at least a report. 



The apparatus of Claim 97. further comprising 



wo 2004/061740 PCT/US2003/041413 

-48- 

means for providing said at least a report as at least one of a basic report 
and an extended report. 

99. The apparatus of Claim 98, further comprising 

means for allowing free access to said basic report. 

100. The apparatus of Claim 98, further comprising: 

means for receiving billing information for providing said extended report. 

101 . The apparatus of Claim 97, wherein said report is provided in view of at least one 
of a user profile and an affinity group. 

102. The apparatus of Claim 93, wherein said communication means comprises at 
least one of a local area network, a wide area network, and the world-wide-web. 

103. A system for the purpose of performing automated surveys, comprising: 

a network connected to at least a client, said client configured with at 
least a Web browser; 

a database for storing at least a plurality of survey questions and 
prospective answers; and, 

a server having access to said network and said database, said 
server configured to at least survey at least a user using said plurality of 
survey questions and prospective answers and for selecting said questions 
and respective prospect answers based on at least a response provided to a 
previous question, for creating user profiles, for creating at least an affinity 
group based on a plurality of user profiles, and for associating said user 
profile with at least an affinity group. 
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USER ENTERS 
A SURVEY 
WIZARD 



FIRST TIME 
WIZARD 



WIZARD 
SUGGESTS 
NEXT . 
QUESTION 



NO MORE 
QUESTIONS 



FIG, 3 



DISPLAY 

NEXT 
QUESTION, 
POSSIBLE 
ANSWERS 



SAVE 
ANSWERS 



SURVEY 
COMPLETE 



REQUEST FOR NEW 
QUESTION 



PROFILE DEFINITION KEY 
DOES NOT EXIST IN HASH TABLE 



FIND TOP 1FIELDGR0UP THAT USER HAS NOT ANSWERED. 
BUTTHAT IS RELATED TO QUESTIONS THAT THEY HAVE ANSWERED. 

AMONG THESE QUESTIONS. ORDER THEM BY THE FOLLOWING CRITERIA: 

1. AT THE HIGHEST UEVEL AS DEFINED BY THE LEVEL DOCUMENT FOR THIS WIZARD 

2. THE MOST COMMON QUESTION AMONGST ALL OF THE GROUPS 
THAT THE USER IS IN (COUNT) 

. THE MOST POPULAR QUESTION AMONG AFFINITY GROUPS THAT ARE 

MORE COMPLEX. (AFFINTTYJJEPTH) 
. THE MOST POPULAR QUESTION AMONG THOSE SAME AFFINITY GROUPS. (MAX) 

IF NONE EXIST. RETURN NULL 



RETURN NEXT 
FIELDGROUPORNULLIF 
NONEAVAILABLE 



FIG. 4 
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INDUSTRY 




LAW 


JOB 


TITLE 


LAWYER 


JOB 


YEARS EXPERIENCE 


5 


SALARY 


AMOUNT 


$72,000 


SALARY 


CURRENCY 


USD 


SALARY 


WORKWEEK 


40 HOURS 


LOCATION 


CITY 


SAN DIEGO 


LOCATION 


STATE 


CA 


LOCATION 


tin i'w'i w M 

COUNTRY 


UoA 


BAR ASSUCIATluN 




UH uMn MOuULfl/iliUlv 


BAR ASSOCIATION 




us BAR ASSOCIATION 


SCHOOL 


.NAME 


HARVARD UNIVERTY 


SCHOOL 


DEGREE 


BA. 


SCHOOL 


YEAR GRADUATED 


1994 


SCHOOL 


NAME . 


GEORGETOWN UNIV 


SCHOOL 


DEGREE 


JD 


SCHOOL 


YEAR GRADUATED 


• 1998 


BENEFITS 




CORNER OFFICE 


BENEFITS 




FREE COFFEE 


BENEFTTS 




HEALTH PLAN 


BONUS 


AMOUNT 


$10,000 


BONUS 


CURRENCY 


USD 


BONUS 


PERIOD 


YEARLY 



FIG. 6 



SUBSTITUTE SHEET (RULE 26) 



wo 2004/061740 



in/5A1156 

PCT7uS2003/041413 




6133 



USER REQUESTS 
NEXT QUESTION 



WIZARD MUST DETERMINE 
WHAT NEXT FIELDGROUP 
IS. 



USER 



GET SOURCE QUESTIONS: 

SYSTEM DETERMINES WHICH 
QUESTIONS THESE AFFINRY 
GROUPS COME FROM. (IE.IFTHE 
AFFINITY GROUP IS 
J0B=PROGRAMMER. THE 
QUESTION THAT TT REFERS TO IS 
"JOB"). LETSSAYTHISUSTIS 
"JOB", "INDUSTRY, AND 'Ctir. 



SYSTEM LOOKS ATUST OF 
AFFINITY GROUPS THAT THE 
USER BELONGS TO 



GETANSWERED 
FIELDGROUPS; SYSTEM 
LOOKS UP ALL OF THE 
QUESTIONS THAT WE 
HAVEANSWERED. 
LETS SAYTHATUSTIS "JOB", 
"INDUSTRY*' AND "CnY" 



- SYSTEM THEN TAKES THE ANSWERED 
QUESTIONS, AND LOOKS UP WHICH 
PARENT QUESTIONS ARE QUESTION 
RELATED TO THOSE CHILD QUESTIONS. 
WE DO THIS FOR EACH QUESTION WE 
HAVE ANSWERED. FOR "JOB" THAT USTIS 
"INDUSTRY" AND "SKia" FOR "INDUSTRY' 
IT IS BLANK AND FOR "CRY' IT IS "JOB"' 
SO OUR FINAL UST ONIY CONTAINS "JOB". 
"INDUSTRY AND "SKILL". BUT WE 
HAVEN'T ANSWERED "SKILL", SO WE 
REMOVE THAT ONE. • 



I 



J 



SYSTEM THEN GOES BACK AND 
FINDS THE SUBSET OF 
RELEVANT AFFINITIES THAT 
WE ARE IN THAT MATCH BACKTO 
THIS UST OF QUESTIONS. THESE 
ARE THE GROUPS THAT ARE 
RELEVANT TO JHE ANSWER INCUR 

CASE, WE LOOK UP ALL THE 
AFFINITY GROUPS WE ARE IN THAT 
CONTAIN INDUSTRY AND JOB. IN 
OUR CASE, THAT IS 
"JOB=PROGRAMMER" AND 
"INDUSTRY=INTERNET^ 



FIG. 7 
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THEN miDOK AGAIN AT THE QUESTION RELATIONS, AND FIND THEUSTOF 
RELATED CHILDREN FOR OUR NEW UST (INDUSTRY & JOB). SUCH THAT 
WE HAVE NOT ANSWERED THESE QUESTIONS SO THE CHILDREN OF 

"JOB" ARE "EMPLOYER" AND "CERTIFICATION". THE CHILDREN OF 
INDUSTRY ARE "JOB" "BUSINESS TYPE'. AND "CERTIFICATION", BUT 
WE'VE ALREADY ANSWERED JOB. SO OUR UST ENDS UP BEING 
"EMPLOYER", "CERTIFICATION" AND "BUSINESS TYPE' 



THEN OUR SYSTEM LOOKS IN THE POPULAR QUESTION TABLE. AND FINDS ALL 
THE POPULAR QUESTIONS FOR THE GROUPS WE ARE IN. OF THOSE 
POPULAR QUESTIONS. WE MUST ONLY CHOOSE ONE OF THE RELATED 
QUESTIONS, SO THAT LEAVES "EMPLOYER' AND "CERTIFICATION". IF 
NO POPULAR QUESTIONS ARE FOUND IN THE POPULAR QUESTION TABLE 

THAT MATCH OUR UST. NO QUESTION IS RETURNED. IFONIYONE 
QUESTION IS FOUND. THAT QUESTION IS RETURNED. (THOUGH NOT TO THE 
USER YET! STIU MORE STEPS TO GO) IN OUR CASE. "EMPLOYER' IS 
FOUND FOR BOTHJOB=PROGRAMMER (WITH 100 PEOPLE) AND 
INDUSTRY=INTERNET(WrTH 2000 PEOPLE). BUT CERTIFICATION IS ONLY 

FOUND FORJ0B=^PROGRAMMER (WITH 105 PEOPLE) 
AND BUSINESS TYPE IS FOUND IN INDUSTRY^INTERNET WITH 25 PEOPLE. 



EACH SUGGESTED QUESTION HAS TWO ASSOCIATED^ ATTRIBUTES. ■ 
TPS COUNT AND TPS POPULARITY. THE COUNT REFERS TO HOW MANY 
TIMES THIS ANSWER HAS APPEARED. SINCE FT CAN ONIY APPEAR 
ONCE PER AFFINRY. THE MORE AFFINITIES THAT SUGGEST THIS 
ANSWER, THE HIGHER IT IS RANKED. IN OUR CASE. EMPLOYER 
HAS A COUNT OF 2 AND CERTIFICATION HAS A C0UNT0F1AND 
BUSINESS TYPE HAS A COUNT OF 1 



C ONTINUED ON 
"'.SUGGEST QUESTION 
USE CASE PAGE 2" 



FIG. 7 
(Continued) 
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EACH SUGGESTED QUESTION 
ALSO HAS A POPULARITY, WHICH 
IS A TAUy OF THE NUMBER OF 
PEOPLE WHO ANSWERED THAT 
QUESTION FOR A GIVEN 
AFFINITY. IN OUR CASE. EMPLOYER 

HAS A POPULARRY OF 100 AND 
CERTIFICATION HAS A POPULARRYOF 
105. AND BUSINESS TYPE HAS A 
P0PULARnY0F25 



THIS USTIS THEN PASSED TO THE 
WIZARD IN THE. GIVEN ORDER. SO 
THE USTIS 
"EMPLOYER" 
"CERTIFICATION" 
"BUSINESS TYPE" 



EACH QUESTION HAS A 
CORRESPONDING LEVEL, FROM 1 TO 
INFINITY. 1 1S THE LOWEST LEVEL A 
USER HAS A CORRESPONDING LEVEL, 
WHICH IS THE HIGHEST LEVEL OF 
ANY QUESTION THE USER 
HAS ANSWERED. 
IN OUR CASE. "EMPLOYER" IS 
LEVEL SAND "CERTIFICATION" IS 
LEVEL 5 AND BUSINESS TYPE IS 
LEVEL 2. THE USER HAS 
ANSWERED "JOB" (LEVEL 2) 
'INDUSTRr (LEVEL 1). AND "CITY' 
(LEVEL 3). SO THE USER HAS A 
CORRESPONDING LEVEL OF 3. 



THE WIZARD THEN COMPARES THIS 
ORDERED UST TO THE LEVELS 
DOCUMENT THERE. R CHECKS 
WHETHER THE QUESTION MATCHES 
THE APPROPRIATE 
CONSTRAINTS, AND IF NOT. 
SUGGESTS ANOTHER QUESTION 



SINCE BUSINESS TfPE IS BELOW 
THE LEVEL OF THE CURRENT USER. RIS 
AUTOMATICALLY DISQUAUFIED. ONLY 
QUESTIONS AT THE SAME LEVEL OR 
ABOVE CAN BE CONSIDERED. 



NOW. OUR UST LOOKS UKE 

EMPLOYER (LEVEL 5) 
CERTIFICATION (LEVEL 5) 



I 



WE THEN LOOK TO SEE WHAT IS THE 
NEXT LEVEL THAT HAS QUESTIONS WE 
HAVE NOT ANSWERED. THAT IS, 
LEVEL 4. IF LEVEL 4 IS A . 
REQUIRED LEVEU THEN WE MUST 
SUGGESTTHE DEFAULT 
QUESTION FOR LEVEL 4. (EACH 
REQUIRED LEVEL MUST HAVE A 
DEFAULT QUESTION). • 



THE USER IS THEN PRESENTED WRH 
THE "EMPLOYER" QUESVON 



IN OUR CASE, LEVEL 4 IS NOT 
REQUIRED. SO -WE SUGGESTTHE 
TOP QUESTION FROM OUR UST: 
EMPLOYER. 



FIG. 8 
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USER REQUESTS 
NEXT QUESTION 



NEXTQUEST/ON 
SUGGESTIS 
'•EMPLOYER" 



W/ZARD MUST FIND 
SUGGESTED ANSWERS 
FOR EMPLOYER, TO SHOW 
TO USER 



USER 



GET SOURCE QUESTIONS: 

SYSTEM DETERMINES WHICH 
QUESWNS THESE AFFINTfY 
GROUPS COME FROM. (IE, IF THE 
AFFINRY GROUP IS 
JOB=PROGRAMMER,THE 
QUESTION THAT IT REFERS TO IS 
"JOB", "INDUSTRr. AMD "CTIT. 



SYSTEM LOOKS ATUST OF 
AFFINITY GROUPS THAT TH^ 
USER BELONGS TO 



SYSTEM THEN TAKES "SOURCE 
QUESTIONS", AND LOOKS UP THE 

SUBSET OF THESE QUESTIONS 
WHICH ARE ANSWER RELATED TO 

THE CURRENT QUESTION 
(EMPLOYER). SO WE LOOK IN THE 
ANSWER RELATIONS TABLE, AND FIND 
OUT WHICH OF "JOB", INDUSTRY, AND 
CUYARE RELATED TO EMPIDYER. fT 
TURNS OUT THAT "JOB" AND "CUT 
ARE RELATED, BUT NOT INDUSTRY, SO 
THE USTIS FILTERED TO JOB AND CITY 



SYSTEM THEN GOES BACK AND 
FINDS THE SUBSET OF 
RELEVANT AFFINITIES THAT 
WE ARE IN THAT MATCH BACK TO 
THIS UST OF QUESTIONS. THESE 
ARE THE GROUPS THAT ARE 
RELEVANTTO THE ANSWER. IN OUR 

CASE. WE LOOK UP ALL THE 
AFFINITY GROUPS WE ARE IN THAT 
CONTAIN JOB AND CRY. IN OUR 
CASE. THAT IS 
VOB=PROGRAMMER" AND 
"CnY=REDMOND" 



FIG. 9 
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SYSTEM THEN LOOKS UP IN THE AFFINITY POPULAR ANSWER TABLE. 

AND FINDS ALL THE POPULAR ANSWERS TO THE "EMPLOYER" 
QUESTION, RESTRICTED TO THE SET OF RELEVANT AFFINITIES SO 

NOW WE LOOK UP' IN A TABLE THE POPULAR ANSWERS TO THE 
"EMPLOYERS QUESTION FOR THE GROUPS "JOB^PROGRAMMER' 
AND 'CTr/=REDMOND'. THE JOB^PROGRAMMER UST CONTAINS 
MICROSOFT WITH 40 PEOPLE. AMAZON.COM WITH 10 PEOPLE. AND 
DRUGST0RE.COM WTTH 4 PEOPLE. THE UST WITH CnY=REDMOND 
CONTAINS MICROSOFT WfTH 30 PEOPLE. REDMOND SUPERMARKET 
WfTH 5 PEOPLE AND REDMOND FIRE DEPARTMENT Wrm 1 PERSON. 



EACH SUGGESTED ANSWER HAS TWO ASSOCIATED ATTRIBUTES. 

ITS COUNT AND ITS POPULARRY THE COUNT REFERS 
TO HOW MANY TIMES THIS ANSWER HAS APPEARED. SINCE TT CAN 
ONiy APPEAR ONCE PER AFFINITY. THE MORE AFFINTTIES 
THAT SUGGESTTHIS ANSWER. THE HIGHER TT IS RANKED. 
IN OUR CASE, MICROSOFT HAS A COUNT OF 2. AMAZON HAS A . 
COUNT OF 1. REDMOND SUPERMARKET HAS A COUNT OF 1. ETC. 



EACH SUGGESTED ANSWER ALSO HAS A POPULARITY, WHICH 
IS A TALLY OF THE NUMBER OF PEOPLE WHO ANSWERED THAT 
VALUE FOR A GIVEN QUESTION/AFFINITY PAIR. IN OUR CASE, 
MICROSORHASA POPULARITY OF 40, AMAZON HAS A 
POPULARRYOF 10. REDMOND SUPERMARKET HAS A • 
POPULARITY OF 5 ETC. 



CONTINUED ON 
':SUGGEST ANSWER 
USECASEPAGE2" 



FIG. 9 
(Continued) 
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THESE ANSWERS ARE THEN ORDERED, FIRST 
BY THE COUNT, THEN BY THE MAXIMUM 
POPULARITY (IE, IF A SUGGESTED 
ANSWER HAS TWO DIFFERENT POPULARTTIES 

FOR TWO DIFFERENT GROUPS (SUCH AS 
INDUSTRY-=INTERNET. AND CnY=REDMOND) 
THE GREATER VALUE IS USED THEN WE UMIT 
THIS USiT TO THE TOP 10 OF THESE ANSWERS 



HOWEVER, IF THIS QUESTION OS A 
DROPDOWN, THEN WE MUST 

SUGGEST OTHER ANSWERS, EVEN IF 
THEY DON'T APPEAR ON THE 

POPULARRYUSl IN THIS CASE, THE 

10 ANSWER UMIT DOES NOTAPPLY 
AND THE DROPDOWN ALWAYS 
CONTAINS ALL THE POSSIBLE 

CHOICES. AN EXAMPLE OF THIS IS A 
'COUNTRT. LIST. WHERE ALL THE 
COUNTRIES MUST BE USTED. 



IN OUR CASE, THE UST WOULD LOOK 
UKE: 
MICROSOFT 
AMAZONCOM 
REDMOND SUPERMARKET 
DRUGST0RE.COM 
REDMOND FIRE DEPARTMENT 



THAT IS THE UST OF SUGGESTED • 
ANSWERS FOR EMPLOYER; FOR THIS 
. . USER HE MAY CHOOSE ONE OF 
THOSE ANSWERS. OR SELECT ONE 
FROM ANOTHER UST, OR CREATE A 
NEW ANSWER 



FIG. 10 
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PROFILE DATABASE 



PROFILE DATA IS TOKENIZED 
INTO AN OPTIMIZED FORMAT 
SEARCHABLE BY SQL SERVER 
FULL TEXT INDEX 



FIG. 12 





TOKENIZED DATA IS STORED IN 





A SQL SERVER DB TABLE 



NEW VALUE ADDED TO 
SYSTEM BY USER 



AUTOMATICAUY GENERATED 
AFFINRY GENERATED WITH THAT 
VALUE AS A NEW VALUE 



MANUAL AFFINRY QUERY 
GENERATED BY SYSTEM 
ADMINISTRATOR WITH MORE 
eOMPLEXLOGIC, SUCH AS 
AND. OR, NOT. WILDCARD, 
. ETC 



AFFINITY GROUP DEFINITIONS 
Are DEFINED AS PROFILE 
SEARCH ENGINE QUERIES, ' 
AND PERIODICALLY, SYSTEM 
RUNS THROUGH AU AFFINTIY 
GROUPS AND POPULATES A 
TABLE WfTH All PROFILES FOR 
EACH GROUP 



PROFILES SEARCH ENGINE 
POPULATES AFFINin GROUP 
DATABASE WITH NEW DATA 
FROM QUERIES. 



FIG. 13 



AFFINffYGROUP 
DATABASE. 
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USER ORDERS PERSONAUZED 

COMPENSATION REPORT 




YES 



USER MUST COMPLETE FIRST 
TIME WIZARD TO ORDER 
COMPENSATION REPORT 



FIND MATCHING PROFILES 
(USING PROFILES SEARCH 
ENGINE + GOAL DOCUMENT) 



AGGREGATE MATCHING PROFILE 
DATA 

(USING REPORTING ENGINE) 



FORMAT SMART REPORT FOR 
VIEWING 



FIG. 14 
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SURVEYS 
RANKINGS 




~Z SEARCH DOCUMENT 
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LOOKUP ALL MATCHGHOUPS FOR THIS 
PROFILE SEARCH. IN ORDER FOR A 
MATCHGROUP TO BE SATISFIED, AT 

LEAST ONE QUESTION IN THE 
MATCHGROUP MUST HAVE A HIT. 
A MATCHGROUP IS A SET OF 
QUESTIONS. 



I 



LOOK UP ALL PROFILES THAT MATCH FOR EACH 
MATCHGROUP MATCHING PROFILES ARE 

EITHER EXACT MATCHES, OR AFFINITY 
MATCHES. EXACT MATCHES MEAN THAT 
USER HAS ANSWERED EXACTLY THE SAME 
ANSWER AS THIS PROFILE, WHEREAS AFFINITY 

MATCHES MEAN THAT USER IS IN THE SAME 
AFFINHY GROUP AS THIS PROFILE. A CLASS OR 
CLASSES OF AFFINITIES TO BE USED FOR THIS 
COMBINATION IS SETIN THE COMBINATION 
IF NO CLASSES ARE DEFINED, THEN NO 

AFFINTTIES WILL BE SEARCHED. 
DISTINGUISHING CLASSES ALLOWS THE 
SYSTEM TO USE DIFFERENT AFFINITIES FOR 
DIFFERENT SEARCHES, 



FIG. 16 



PROFILES ARE SCORED BASED 

UPON THE TYPE OF MATCH 
EXACT MATCHES ARE GIVEN A 
HIGHER SCORE (DEFINED BY 
ADMIN) AND AFFINfTf MATCHES 
ARE GIVEN A LOWER SCORE 
(DEFINED BY ADMIN). IF MORE 
THAN ONE MATCHGROUP EXISTS IN 
A COMBINATION. AND IT IS ONLY A 
PARTIAL EXACT MATCH, THEN FT IS 
CONSIDERED AN AFFINITY MATCH. 
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A PROFILE'S EXACT MATCH SCORE 
FOR A MATCHGROUP IS DETERMINED 
BY TAKING THE NUMBER OF TIMES IT 
HAS EXACT MATCHED IN THE 
MATCHGROUP. THEN MULTIPLYING THAT 
NUMBER BY THE EXACT MATCH 
SCORE DEFINED FOR THE 
MATCHGROUP 



A PROFILE'S AFFINITY MATCH SCORE 
FOR A MATCHGROUP IS DETERMINED 
• BY TAKING THE NUMBER OF TIMES fT 

HAS AFFINITY MATCHED IN THAT 
MATCHGROUP AND THEN MULTIP&ING 
THAT NUMBER BY THE AFFINHY MATCH 
SCORE 



• THE TWO SCORES ARE ADDED UP. AND 
THAT IS THE PROFILE'S SCORE FOR THAT 

MATCHGROUP IF THE SCORE IS GREATER 
THAN THE MAXSCORE ALLOWABLE FOR 
THAT MATCHGROUP, THE MAXSCORE IS 
USED INSTEAD. IF THE DETERMINISTIC 

FLAG IS SET TO 1 FOR THIS MATCHGROUPr 

ALL PROFILES THAT MATCHED FROM THIS 
COMBINATION ARE EUGIBLE FOR INCLUSION 
INTO' THE FINAL PROFILE SET 



THE TOTALSCORE OF EACH PROFILE IS 
GIVEN BY ADDING UP THE PROFILE 
SCORES FROM EACH MATCHGROUP 
PROFILES MUST HAVE THE DETERMINISTIC 
FLAG SET BY AT LEAST ONE COMBINATION' 
TO BE CONSIDERED. OTHER PROFILES 
ARE DISCARDED 



FiG. 16 
(Continued) 



SUBSTITUTE SHEET (RULE 26) 



PCT/US2003/041413 



18/33 




AFFINnV GROUPS ARE CHOSEN 
AS FILTERS AND GIVEN A RANKING. 

THE FIRST RANKING WfTH THE 
MINIMUM NUMBER OF PROFILES IS 
CHOSEN. AND ONLY PROFILES IN 
THAT FILTERS ARE RETURNED. 



RANKINGS ARE DEFINED AS A 
RANGE OF SCORES. IFASCOREIS 
BELOW THE LOWEST RANKING, IT IS 
DISCARDED. OTHER PROFILES ARE 
MAPPED FROM THEIR SCORES TO 
THEIR RANKINGS, AND THEN 
ORDERED BY SCORE FROM 
HIGHEST TO LOWEST 



IF THE NUMBER OF PROFILES 
REMAINING IS LESS THEN THE 
MINIMUM COUNT, A MESSAGE IS 
RETURNED STATING THIS. AND 
APPROPRIATE ACTION IS TAKEN BY 
THE SYSTEM (IE. NOT CHARGING . 
THE USER). IF MORE THAN THE 
MAXPROFILE COUNT IS AVAILABLE, 
THE SET IS UMfTED TO MAXCOUNT 
PROFILES (IN DESCENDING ORDER). 
THE REMAINING PROFILES 
ARE DISCARDED 



THIS FINAL SET OF PROFILES IS 
RETURNED TO THE REPORTING 
ENGINE FOR AGGREGATION AND 
ANAiySIS 



FIG. 16 
(Continued) 
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1. If any answer exists for tfie field Degree, and tfie profile also contains 
Certification ^^degree" and/or Certification ="Diploma in Information 
Technologf. then remove those value(s) for Certification. 

2 If an answer for Benefits/Perks~''l^edical/Denta//Vision/Heatth 

Insurance" exists and profile also contains Benefits/Perks="Dental Insurance** 
and/or Benefits/F^rks=''Health Insurance" then remove those latter value(s) for 
Benefits/Perks. 

3. If any Currency < > "tJS - Mars" then flag the profile for review. (This 
rule to be removed at a later time when the system has gained certain levels of 
comfort with non-US profifes). 

4. If profile does not contain an answer for Salary or Hourly Rate, then flag 
the profile for review. 

5. If profile contains any non-zero value for Salary or Hourly Rate, and also 
contains answers for the FieldGroups Profit Share. Monthly Royalty, or Daily 
Income with the values of 0, then remove the fieldgroup(s) for those that contain 
values of 0. 

6. If profile contains a zero value for all compensation questions in the 
profile, then deactivate the profile. 

7. If the Currency field does not match for all compensation questions in the 
profile, then flag the profile for review. 

8. . If any fietd except the Job field contains "n/a" or "none^ then global remove 
the value. If the field was for Job, then flag the profile for review. 

ft Profiles should also be marked for review if they contain a number of 
answers to fields according to this table: 
Field Benefits/Perks ...if>=8 answer values in profile 
Field Job ... if > =4 answer values in profile 
Field Primary Responsibilities ... if > -8 answer values in profile 

- . Skill. ..if > =8 values 

Industry... if > =5 values 

Other fields are ok to pass through. 

FIG. 19 
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10. If there is no value for Country but ttiere is, a non-zero value for Salary or 
Hourly Rate witti Currency ="US - Dollars'', and there is.a value for Job. and the 
email address does not end in ".ca", ".fiA"; etc-, then add Country = "United 
States" to the profile. 

1 1. If cunency= US and salary is <$8000 then mark for review. If Hourly 
rate > 350. Or < 5 US Dollars, also mark for review. Do this similar rule again 
for other currencies and salary/hourly rate ranges. 

12. If any of the following "rare" FieldGroups exist in a profile (Position, 
Tenured, Runs Batted In, etc), then flag the profile for review. 

13. If there is no Employer Name but there is a value for ProductActivity. then 
remove any and all ProductActivity answers for the profile, BUT only do it if there 
is no other reason for the profile to be flagged for review from other rules. 

14. If there are no compensation answers at all. then deactivate profile. 

15. If email name contains funny words like "needajob" or "noemail" or 
"johndoe" or "asdf or "qwerty", or "test, etc, then flag profile for review. 

16. If either of the City or State Fields is the same as a known Country name. * 
but the profile's answer for Country is not the same as the profile's answer for . 
City and/or State, then flag the profile for review. 

1 7. The No-Answers rule inactivates and niarks a profile reviewed if there are 
no answers at all in the profile. Also, if there are only Industry FieldGroups ' .> 
answered (either confirmed or un^onfinned) and no other types of FieldGroups . 
answered, then also inactivate and mark it reviewed. 

18. If the Employer Name is like "PayScale" or "private" or "none of your 
business", etc, the deactivate profile. 

19. If the email name contains "undeqjaid.com". "payscale.com". (internal 
test email addresses) then deactivate the profile. 

20. If there is more than 1 answer for Benefits/Perks, but one of -them is "None 
(contract-based)", then the answer "None (contract-based)" should be removed 
from the profile. 

FIG. 19 
(Continued) 
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21. If both Job = "Sr. Software Engineer / Developer I Programmer*' and 

Job = "Software Engineer I Developer I Programmer" in the profile, ttien remove 
the latter one from the profile. If both Job = "Consultant, fT and 
Job = "Consultant" also in the profile, then remove the latter onje. If both 
Job = "Senior Database Administrator (DBA)" and Job = "Database 
Administrator (DBA)" then remove the latter one. 

22. If Years in Field = 0, and the profile's Employment Status I search goal 
is NOT "student/evaluating job offer, then mark profile for review. • 

23. If a profile has an unconfirmed (new) value for Certification, and there is 
no Degree answered in the- profile, then if the new answer for Certification is 
already an exact match of an existing value for the "Degree" field, remove the 
unconfirmed Certification from the profile and add the known Degree instead. 

24. Profiles with these Job combinations should be marked for review: 
(Associate Attorney OR Entry-Level Attorney) AND (General Counsel OR Partner - 
Law Firm). 

25. Check/apply all above rules to the profile first. If there is no reason for the 
profile to be deactivated or flagged for review, but if a profile has no Smart 
Report yet and there is a value for Job that woukJ succeed if the Smart Report 
was run, then automatically order and deliver a smart report for this profile. . 

26. Check/apply all above niles to the profile first: If there is no reason for the 
profile to be deactivated or flagged for review, and if there is a value for Country, 
a non-zero value for Salary or Hourly Rate, and value for Job that would 
succeed the Simrt Report when run (or if the Is^st Smart Report is known to . 
have succeeded), then Activate the pmfile. 

NG. 19 
(Continued) 
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